AI-Powered Test Generation MCP Server - generates, analyzes, and validates tests across multiple programming languages using LLM APIs
Three tools with complete JSON schemas and basic descriptions, but significant gaps in parameter documentation and error handling. Tool names follow verb_noun convention (testgen_generate, testgen_analyze, testgen_validate), which is good. However, descriptions are minimal (34-72 chars, below the 50-200 char LLM-optimized baseline). Most parameters lack descriptions entirely, e.g., 'api_version', 'request_id', 'recursive', 'cost_estimate' have no explanatory text. No output schemas documented. No error recovery guidance. No parameter constraints (enums, ranges, patterns). Security concern: 'provider' parameter exposes LLM provider selection without validation or scope declaration.
Analyze a codebase for test generation readiness and cost
Generate tests using TestGen's shared application layer
Validate generated or existing tests for a path
Parameter descriptions missing or absent. 'api_version', 'request_id', 'recursive', 'cost_estimate', 'detail', 'min_coverage', 'fail_on_missing', 'report_gaps', 'parallelism', 'batch_size', 'provider' lack any explanatory text. LLMs cannot infer parameter meaning from names alone.
Tool descriptions are too brief (34-72 chars vs. 50-200 char baseline). 'Generate tests using TestGen's shared application layer' does not explain WHEN to use this tool, what it returns, or how it differs from testgen_validate. Insufficient for LLM tool selection.
No output schemas documented. LLMs cannot plan downstream calls or extract required fields (e.g., does testgen_generate return file paths, test counts, coverage metrics?). Breaks tool composition.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 49 | 2026-07-28+ | v2 |
'provider' parameter (anthropic, openai, gemini, groq) should be an enum constraint, not free-form string. No validation or scope declaration. Exposes LLM provider selection without permission gating or audit trail.
No error handling guidance. If testgen_generate fails (invalid path, permission denied, LLM timeout), the response provides no recovery hint. Agents cannot self-correct or retry intelligently.