Vibrissa is a JSON-driven MCP testing framework, not a production tool server. The two fixture tools (echo, fail) are minimal test harnesses, not production-grade implementations. Tool descriptions are present but extremely terse (12-45 chars). Parameter descriptions are completely absent, the 'text', 'uppercase', and 'message' params have no descriptions explaining their purpose, format, or constraints. Input schemas are properly structured with types but lack the rich metadata (minLength, maxLength, pattern, enum) that production tools require. No error handling guidance is visible in the fixture server. The server functions as a test runner for evaluating MCP servers, not as a real service, so enterprise patterns (pagination, idempotency, rate limiting, audit trails) are not applicable. Scoring reflects that this is a test fixture, not a production tool, fixture tools consistently score lower because they omit domain logic and user-facing polish.
Echo text back, optionally uppercased
Always returns a tool execution error
Parameter descriptions completely missing. The 'text' parameter (required string) has no description explaining what text it should contain, format constraints, or length limits. The 'uppercase' parameter (boolean) lacks any explanation of its purpose or default behavior. The 'message' parameter in 'fail' tool is undescribed.
Tool descriptions are extremely terse (12 - 45 characters). 'Echo text back, optionally uppercased' (43 chars) and 'Always returns a tool execution error' (38 chars) lack context for when an LLM should select these tools, what they return, or use cases. Production baseline is 194 chars average.
Input schemas lack production constraints. No minLength, maxLength, enum, or pattern fields. The 'text' parameter could be 1 char or 1 MB, no bounds declared. An LLM cannot infer valid input ranges.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-22 | F | 44 | 2026-07-28+ | v2 |
| 2026-03-09 | F | 0 | - | v1 |
No output schema documentation. Neither tool explicitly declares what fields or structure will be returned. LLMs cannot plan downstream tool calls without knowing response shape.
Error handling provides no recovery guidance. The 'fail' tool returns an error message but does not guide the LLM on whether to retry, ask the user, or abandon the plan.
STDIO transport only. Server is not remotely accessible and cannot be used by hosted MCP clients or cloud agents. Hard cap on protocol readiness score applies.