A multi-agent system using MCP servers (Math and Weather) with LangGraph and LangChain for agent orchestration
Three tools with minimal definitions. All have descriptions (10-30 chars, below the 50-200 char baseline for LLM optimization), no parameter descriptions beyond type hints, and no documented output schemas. Naming is verb-based (add, multiply, get_weather) but descriptions lack context on WHEN to use each tool or what they return. No error handling, no input validation guidance, no composition hints. Schemas are inferred from type hints rather than explicit JSON Schema declarations.
Add two numbers.
Get weather for a location.
Multiply two numbers.
Descriptions are too short (10-30 chars vs. baseline 50-200). 'Add two numbers' and 'Multiply two numbers' lack context on when to use these tools, what they return, or error cases.
No parameter descriptions. Parameters 'a', 'b', 'location' have types but no guidance on valid ranges, formats, or constraints. LLMs cannot infer whether 'a' accepts negative numbers or floats.
No documented output schemas. Tools return int or str but no schema declares structure, field names, or error response format. LLMs cannot plan downstream calls or extract results reliably.
No error handling or recovery guidance. If get_weather receives an invalid location, the tool returns a placeholder string. No error classification, no actionable recovery steps for the LLM.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 47 | 2026-07-28+ | v2 |
Numeric parameters (a, b) lack constraints. No min/max bounds, no guidance on whether negative numbers or zero are valid. Unbounded parameters invite absurd LLM inputs.