FastAPI-based MCP server that integrates OpenAI's API with MCP tools for sales and finance data retrieval, featuring a Gradio chat interface
Both tools have minimal definitions. Tool names are acceptable (verb_noun pattern), but descriptions are extremely short (11-16 chars, well below the 34-char p10 baseline). Input schemas are empty objects with no properties, violating the requirement that parameters have type definitions. No output schemas are documented. No error handling guidance. Tools appear to be simple GET endpoints returning hardcoded data, but the MCP registration does not expose proper schemas or parameter documentation.
Get finance data
Get sales data
Empty input schemas: both tools declare input as {"type":"object","properties":{}} with no parameters defined.
Descriptions are trivial (11-16 characters). Baseline p10 is 34 chars; these fall far below. LLMs cannot determine when or why to select these tools.
No output schemas documented. LLMs cannot plan downstream tool calls or extract the right data without knowing what fields to expect.
No error handling or recovery guidance. If a tool fails, the LLM has no actionable next step.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 36 | 2026-07-28+ | v2 |
Tools return hardcoded mock data (sales/finance arrays). No indication of whether these are real API calls, mock responses, or placeholders. Descriptions should clarify purpose and data freshness.