From-scratch Model Context Protocol (MCP) server and evaluation harness
Single tool 'search_docs' has a clear verb-noun name and basic schema, but lacks depth in parameter descriptions and output documentation. The input schema defines 'query' with a type and brief description, meeting minimum requirements. However, no output schema is documented, and the description (47 chars) is sparse for LLM decision-making. Error handling is minimal, no guidance on what happens if no docs match or if the search fails. The tool is READ_ONLY (safe), but lacks the structured output and recovery hints expected of production tools.
Search bundled documentation by keyword query.
No output schema documented. LLMs cannot plan downstream actions or extract structured data from results.
Tool description is 47 characters, below the 50-200 char baseline for LLM optimization. Lacks context on when to use this tool vs alternatives, what it returns, and any prerequisites.
Parameter 'query' description is minimal (29 chars). Does not specify format constraints, example patterns, or what 'keyword query' means (full-text search? regex? fuzzy match?).
No error handling guidance. Tool returns generic error text on failure (e.g., 'Error executing tool'). LLM cannot determine if error is retryable, user-fixable, or fatal.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | C | 63 | 2026-07-28+ | v2 |
No pagination or result limits documented. If search returns hundreds of docs, context window bloat and token waste. Baseline pattern expects limit/offset and total count.