A minimal, runnable MCP (Model Context Protocol) server over stdio that provides tool execution capabilities for agent learning examples.
Two tools with minimal definitions. Both have basic schemas and descriptions, but lack depth, parameter documentation, and error guidance. 'calculator' description is 60 chars (acceptable baseline ~194), but 'search' is only 54 chars. Neither tool has parameter descriptions beyond the bare type. No output schema documentation. No error handling guidance. No tool annotations. Naming is acceptable (verb_noun pattern), but overall quality is well below production baseline.
Evaluate a basic arithmetic expression, e.g. '12*8'.
Search a small built-in knowledge base for a keyword.
Parameter descriptions missing. 'expression' and 'query' parameters lack descriptions explaining format, constraints, or examples. LLMs cannot infer valid input without explicit guidance.
No output schema documented. Tools return text responses but do not specify structure, fields, or format. LLMs cannot plan downstream operations or extract structured data.
No error handling guidance. Tools catch exceptions and return generic error messages (e.g. 'unknown tool', 'message str(exc)'). LLMs receive no recovery hints or classification (retryable vs fatal).
Tool descriptions too brief. 'calculator' (60 chars) and 'search' (54 chars) lack context on WHEN to use, WHAT it returns, or prerequisites. Baseline is 194 chars; these are 30% of target.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 54 | 2026-07-28+ | v2 |
No tool annotations. Missing readOnlyHint, destructiveHint, or idempotentHint. Both tools are read-only but this is not declared in the schema, forcing LLMs to infer safety.