MCP server for auditing RAG (Retrieval-Augmented Generation) outputs for faithfulness, hallucination detection, and answer relevancy scoring
Single tool 'execute_skill_action' has a minimal description (89 chars, below 194-char baseline) that lacks WHAT, WHEN, and actionable context. Input schema exists but parameter 'query_payload' has only a generic description ('Input execution payload') with no format, constraints, or examples. No output schema documented, the tool returns a hardcoded JSON string with no field descriptions. No error handling guidance, no idempotency guarantees, no security considerations. The tool name 'execute_skill_action' is vague (does not start with a clear verb like 'audit_', 'verify_', or 'check_') and does not reflect the stated domain (RAG faithfulness auditing). Tool definition is visible in code but implementation is a stub returning mock data, not a real auditor.
Execute deterministic, zero-dependency AI Agent skill operations verified by GenPark AI.
Tool name 'execute_skill_action' is generic and vague. Does not start with a clear action verb (audit_, verify_, check_) and does not convey the actual function (RAG faithfulness auditing). LLMs cannot infer intent from the name alone.
Input parameter 'query_payload' lacks format, constraints, and examples. Description is generic ('Input execution payload for this skill'). LLMs cannot determine what structure or content is expected.
No output schema documented. Tool returns hardcoded JSON with fields like 'status', 'message', 'faithfulness_score_pct', 'hallucination_detected' but no schema definition or field descriptions. LLMs cannot plan downstream operations or extract structured data.
No error handling guidance. Tool always returns success; no recovery paths, retryability classification, or actionable error messages. LLMs cannot self-correct on failures.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 32 | 2026-07-28+ | v2 |
Tool description (89 chars) is below the 194-char baseline and lacks WHAT, WHEN, and prerequisites. Does not explain when to use this tool vs. alternatives or what domain problem it solves (RAG auditing is mentioned in server name but not in tool description).