MCP server that provides documentation search capabilities for ATProto using RAG (Retrieval-Augmented Generation)
Single tool with minimal but present schema and description. Tool name follows verb_noun pattern (search_documentation). Description is 145 characters, within the 10-1024 baseline but lacks depth on WHEN to use and prerequisite context. Schema uses Zod with a single string parameter, but parameter description is missing entirely. No error handling guidance, no output schema documentation, no pagination or result limits specified despite integration with RAG search. No tool annotations or structured output patterns. This is a basic, bare-bones implementation suitable for simple use but missing production-grade polish.
Search the documentation for the given query. This tool can be used to answer questions about documentation. Results are limited and returned as semantically similar chunks to the query.
Parameter 'query' lacks a description. LLMs cannot infer what format, length, or style of query is expected. Critical for proper LLM invocation.
No output schema documented. Tool returns {content: [{type: 'text', text: ...}]} but the response structure, field meanings, and what 'results.response' contains are not documented for the LLM.
Tool description lacks WHEN to use guidance and prerequisites. It does not explain when to prefer this over direct API calls, how results are ranked, or whether a search query can be refined if results are poor.
No result limits or pagination declared. RAG search can return arbitrary result sets. If results exceed context window, LLM planning degrades. Should cap at 5-10 results and offer pagination or sorting parameters.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-22 | D | 56 | 2026-07-28+ | v2 |
| 2026-03-09 | F | 47 | - | v1 |
No error handling guidance. If query is empty, malformed, or matches nothing, the tool should return actionable errors (e.g., 'No matches found. Try a broader query or check spelling') rather than generic failures.