MCP server for executing full-stack test plans with support for unit, integration, e2e, and performance testing across multiple environments
Single tool 'execute_skill_action' has a reasonable name and description (127 chars, within 10-1024 range), but critical gaps undermine quality. Input schema is present with three parameters, all with descriptions and types. However, the schema lacks enums for constrained inputs (test_types should enumerate valid options), no output schema is documented, and no error handling guidance exists. The tool description does not explain when to use it vs alternatives, what it returns, or how to interpret results. Parameter descriptions are minimal (e.g., 'List of test types' lacks format/constraint details). No mention of idempotency, side effects, or recovery paths. The implementation is a mock returning hardcoded results, not production-ready.
Execute a full-stack test plan with support for unit, integration, e2e, and performance testing
No output schema documented. LLMs cannot plan downstream calls or extract required fields (e.g., blocking_failures, release_recommendation). Violates pattern:tool requirement for documented return types.
test_types parameter accepts free-form strings instead of enum. Should constrain to ['unit', 'integration', 'e2e', 'performance']. Invites hallucinated values and wastes tokens on validation.
No error handling guidance. Tool description does not explain failure modes (e.g., invalid environment, unsupported test_types) or recovery steps. Violates pattern:recovery-guide.
Description lacks WHEN to use this tool and what distinguishes it from other testing tools. At 127 chars, it is minimal and does not guide LLM selection. Should explain prerequisites, side effects, and expected latency.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 41 | 2026-07-28+ | v2 |
Parameter descriptions are too brief. 'Target environment for testing' lacks constraints (valid values: staging, production?). 'List of test types' does not specify format or dependencies. Violates pattern:tool-description.