MCP Server Verification Tool - analyzes and verifies MCP server implementations for security, guidelines compliance, and description accuracy
Scoring was not performed
Chat tool has NO description. Rule: 'Every tool must have a non-empty description. Without one, LLMs cannot determine when or why to select the tool.' This is a critical blocker for agent tool selection.
Input parameters lack descriptions. The verify tool has three parameters (server_path, description, config) with descriptions, but they are extremely generic (e.g., 'Path to MCP server directory'). The chat tool's 'config' parameter has minimal description. LLMs cannot infer parameter semantics from names alone per pattern:tool-description.
No output schema documentation visible. Tools do not declare what fields they return or the structure of responses. Pattern:tool requires 'Document the output schema. LLMs need to know what fields to expect so they can plan downstream tool calls.' This blocks composition.
No error recovery guidance in descriptions. Neither tool describes what errors are possible, what they mean, or how the LLM should respond. Pattern:recovery-guide requires 'Error responses must tell the LLM what to do next.' Descriptions are silent on failure modes.
Config parameter accepts a file path string with no constraints. No description of valid path formats, required file structure, schema validation, or what happens if the file is invalid or missing. Pattern:constrained-input and param-validation-rules require format and constraint documentation.
Verify tool description does not clarify output. It says 'Verify an MCP server implementation' but does not state: What does verification check? What does 'approved' or 'rejected' mean? What fields does the response contain? This violates pattern:tool-description guidance to state 'What does it do? When should the LLM call it instead? What does it return?'
Naming clarity issue: 'verify' is a bare action verb with no object. Patterns prefer 'verb_noun' (e.g., verify_mcp_server, verify_server_implementation). This makes the tool's scope ambiguous, does it verify server code, configuration, compatibility, or all three?
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-22 | F | 0 | <=2025-11-25 | v2 |
| 2026-03-09 | F | 27 | 1.2.1+ | v1 |