MCP Server for mutation testing coverage analysis and test suite quality evaluation using AST mutant generation
Single tool with basic schema and minimal description. Tool name lacks action verb (should be 'score_mutation' or 'evaluate_mutations'). Description is 73 chars, acceptable but generic. No output schema documented. No error handling guidance. No parameter constraints (enums, ranges, formats). Tool does not follow verb_noun naming convention.
Execute mutation testing on Python source code and test suite.
Missing parameter descriptions. 'original_code' and 'test_cases' have no descriptions in the schema, LLMs cannot infer what format test_cases should take (fn_name, args, expected structure is only in the description text, not in the schema).
No output schema documented. Tool returns JSON with 'msi', 'total_mutants', 'killed_mutants', 'survived_mutants', 'details' fields, but LLMs have no formal schema to understand the structure.
Tool name does not start with action verb. 'evaluate_mutation_score' is awkward; 'score_mutations' or 'evaluate_test_coverage' would be clearer.
No error handling guidance. Code returns generic error messages ('Original code fails to execute', 'Baseline test case failed') without actionable recovery steps.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 40 | 2026-07-28+ | v2 |
No parameter constraints. 'test_cases' array has no minItems, maxItems, or item schema. 'original_code' has no minLength or maxLength.