A plugin system for SolidWorks that manages learner sessions, feedback submission, and validation for a GPT-integrated workflow
This server has severe definition quality gaps. Tool descriptions are present but minimal (10-30 chars), far below the 50-200 char LLM-optimized baseline. Most parameters lack type information in visible schemas, only 'state' and 'payload' show Path types; others are inferred. No output schemas documented. Error handling is absent. Tools like 'start_session' and 'show_session' are vague about what state they manage. The naming is inconsistent: 'preference_show' vs 'preference_always' lacks verb-noun clarity. No tool declares permissions, error recovery paths, or idempotency guarantees. This is a D-grade server with fundamental definition deficiencies.
Remove the temporary feedback payload
Record the accepted feedback ID
Record a payload build
Set consent preference to always
Clear consent preference
Read consent preference
Run self-contained structural and runtime checks for the plugin
Print current session state
Descriptions are critically short (10-35 chars). LLM-optimized descriptions should be 50-200 chars. Current descriptions like 'Print current session state' and 'Record a payload build' lack context for when/why to use each tool.
No output schemas documented. LLMs cannot plan downstream calls or extract required fields without knowing what each tool returns. All 12 tools lack return type documentation.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 35 | 2026-07-28+ | v2 |
Start a new task-scoped session
Submit a validated FeedbackSubmission with bounded curl retries
Validate and normalize a SolidWorks FeedbackSubmission JSON document
Validate the plugin after copying it into Codex's versioned cache layout
Naming inconsistency: 'preference_show', 'preference_always', 'preference_clear' lack verb-noun clarity. Should be 'get_preference', 'set_preference_always', 'clear_preference' for LLM parsing.
No error handling guidance. Tools like 'submit_feedback' and 'validate_feedback' have no documented error cases, recovery paths, or actionable error messages. LLMs cannot self-correct on failure.
Parameter descriptions missing or trivial. 'state' param described only as 'Path to session state file (default: .sw-learner-state.json)', no explanation of what session state contains or when to use it. Affects 8 tools.