MCP server brokers for speckit-pro plugin system, including sweep-broker and author-broker for managing formal verification tools and code authoring workflows
Critical failures across all dimensions. Tool definitions exist only in test validation files, not in actual server code. No input schemas visible in source. Descriptions are minimal (10-50 chars) and lack actionable context. No parameter documentation. No output schema definitions. No error handling guidance. Tools appear to be inferred from test assertions rather than explicitly registered with proper MCP schemas. This is a test artifact, not a production MCP server implementation.
Submit preview verdict for authored artifacts
Write formal model files
Retrieve consensus inputs for sweep analysis
Submit review comments for sweep analysis
List available snapshots for sweep analysis
Read snapshot data for sweep analysis
Search within snapshots for sweep analysis
No input schemas visible in source code. All 8 tools have schema score of 0. Cannot verify parameter types, constraints, or validation.
Tool definitions appear only in test validation file (validate-tool-scoping.py), not in actual server implementation. Tools are inferred from test assertions, not explicitly registered with MCP protocol.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 31 | 2026-07-28+ | v2 |
Submit sweep analysis results
Descriptions are minimal (10-50 chars) and lack context. Examples: 'List available snapshots for sweep analysis' (50 chars) provides no guidance on when to call, what data is returned, or dependencies. Baseline for A+ tools is 50-200 chars with actionable context.
No parameter documentation visible. Cannot verify that parameters have descriptions, types, constraints, or defaults. LLMs cannot infer parameter meaning from names alone.
No output schemas documented. Cannot verify what fields are returned, their types, or whether responses include IDs needed for tool chaining. Baseline for A+ tools is 100% documented return types.