Audit tool for MCP servers — test protocol compliance, schema quality, and robustness
Single tool 'echo_text' has a complete input schema with proper type and required field, and a basic description. However, the description is only 57 characters, below the 194-char baseline for production tools. Output schema is defined in code but not exposed to LLMs via tool metadata. Tool is read-only and idempotent, correctly annotated, but lacks context on when/why to use it. This is a minimal fixture server, not a production tool suite.
Echo the provided text for integration testing.
Parameter 'text' lacks description. LLMs cannot infer what kind of text is expected (plain string, JSON, code, etc.) or constraints (length, format, encoding).
Tool description is only 57 characters. Baseline for production tools is 194 chars (p10=34, p90=392). Current description lacks context on when to use this tool or what it returns.
Output schema is defined in Python code but not exposed in tool metadata returned to clients. LLMs cannot see the structured output format (text field) and must infer it.
Tool name 'echo_text' does not follow verb_noun convention. 'echo' is a generic action. Better names: 'repeat_text', 'validate_text_echo', or 'test_text_passthrough' would clarify intent.
Inferred effective spec: 2025-06-18+.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 47 | 2025-06-18+ | v2 |