Single tool 'query' has a minimal description (24 chars) and severely underdeveloped schema. Input schema lacks parameter descriptions entirely, the 'sql' parameter has no guidance on format, constraints, or examples. No output schema is documented. The tool lacks error handling guidance, recovery hints, and security context (e.g., how read-only is enforced, what happens on malformed SQL). No tool annotations (readOnlyHint, etc.). Naming is acceptable but description and schema quality are far below production baseline (avg description 194 chars, 100% of A+ tools have param descriptions).
Run a read-only SQL query
Parameter 'sql' lacks description. LLM cannot infer format constraints, expected query types, or error recovery.
No output schema documented. LLM cannot plan downstream operations or extract structured data. Baseline: 100% of A+ tools have documented return types.
Tool description is 24 characters ('Run a read-only SQL query'). Rubric baseline: 194 chars avg, 10 - 1024 range. Missing WHEN to use, prerequisites, and what it returns.
No error handling guidance. Code catches errors but returns raw exception. Ensure query is SELECT-only and references valid columns.'
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 38 | 2026-07-28+ | v2 |
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). Code enforces read-only via SET TRANSACTION READ ONLY, but LLM has no metadata hint. Per spec 2026-07-28, tool annotations are a current pattern.