An MCP server that provides tools for searching and retrieving documentation and code samples, with support for markdown docs indexing and git snapshot sampling
Scriptorium has 6 tools with basic descriptions but critical gaps in schema documentation and parameter clarity. Tool names are reasonably verb-based (search, expand, get, summarize, guide), but input schemas are either missing or inferred from test files rather than visible in actual tool registration code. Descriptions are present but generic (10-50 chars), falling below the 50-200 char baseline for LLM-optimized docs. No parameter descriptions visible in schemas. Output schemas are undocumented. Error handling and recovery guidance absent. The codebase shows sophisticated internal logic (diagnostics, caching, git snapshots) but this complexity is not reflected in tool interfaces designed for agent reasoning.
Loaded runtime diagnostics.
Expand related references from seed references
Get content for a reference ID
Build implementation guide for a topic
Search markdown documentation
Summarize flow from seed references
Tool schemas inferred from test files, not visible in actual tool registration. Cannot verify input parameter types, required fields, or constraints. Violates pattern:tool requirement for explicit schema declaration.
Descriptions are 10-50 characters, well below 50-200 char baseline. 'Loaded runtime diagnostics' and 'Search markdown documentation' lack context for when/why LLM should select tool. No WHAT/WHEN/WHY structure.
No parameter descriptions visible in schemas. 'query', 'seeds', 'refId', 'mode', 'style', 'topic', 'language', 'maxRefs' lack explanations of expected format, valid values, or constraints. LLM cannot infer parameter semantics.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 33 | 2025-06-18+ | v2 |
Output schemas undocumented. No visibility into what fields tools return, what types they are, or what IDs/references are included for chaining. Agents cannot plan downstream calls.
No error handling guidance. No recovery hints, retryability classification, or actionable error messages. If a search fails or reference not found, agent has no path forward.