This server has critical gaps in tool definition quality. While it has 3 tools (docs_search, search, execute), the source code provided does NOT contain the actual tool registration schemas, parameter definitions, or descriptions. From the code snippets shown (server.ts, index.ts, oauth-handler.ts), tool implementations are imported but their definitions are not visible. Per HARD SCORING RULE: 'If you cannot see the actual tool definition in the source (only inferred): cap that tool's overall at 50.' Since NO tool definitions are visible in the provided source, and we can only infer they exist, all tools are capped at 50 max. The average of three tools at 50 would be 50, but further examination reveals the source code is incomplete, we cannot verify any schemas, descriptions, or parameter documentation. Conservative scoring applies: assume missing documentation is absent. No tool descriptions visible. No input schemas visible. No parameter type definitions visible. The execute tool is marked as WRITE (destructive) but we cannot see confirmation/dry-run patterns in the code. Without access to the actual tool files (src/tools/docs-search.ts, src/tools/search.ts, src/tools/execute.ts), we must score based on what IS visible: nothing. This is a CRITICAL issue.
Tool definitions not visible in source code. No input schemas, parameter descriptions, or tool descriptions provided. Cannot verify compliance with pattern:tool or pattern:tool-description.
execute tool is destructive (WRITE risk) but no confirmation/dry-run mechanism visible. Per pattern:confirmation-request, irreversible operations should support confirmation steps.
No error handling guidance visible. Error responses must tell the LLM what to do next (pattern:recovery-guide). Cannot verify this is implemented.
Tool naming is reasonable (verb_noun pattern) but vague. 'search' is too generic, does it search docs, API endpoints, or both? Unclear distinction from 'docs_search'.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-22 | F | 41 | 2026-07-28+ | v2 |
| 2026-03-09 | F | 35 | - | v1 |
No visible parameter documentation. Cannot verify that all parameters have type definitions and descriptions per pattern:tool-description and pattern:constrained-input baselines.