Aviation Weather MCP has 6 well-named tools with consistent verb_noun patterns (get_metar, get_taf, get_pireps, get_route_weather, get_sigmets, get_gairmets). All tools have descriptions (avg ~60 chars, baseline 194). Input schemas are present with typed parameters and enums for constrained inputs (region, hazard, type). However, descriptions are terse and lack context on WHEN to use each tool or what the output contains. No documented output schemas visible. Parameters like 'radius' lack min/max bounds. Error handling and recovery guidance are absent from descriptions.
Get G-AIRMETs (Graphical AIRMETs)
Get METAR (current weather observation) for an airport
Get PIREPs (pilot reports) near an airport
Get comprehensive route weather information
Get adverse conditions (SIGMETs)
Get TAF (terminal aerodrome forecast) for an airport
Tool descriptions lack context on WHEN to use each tool and what output structure to expect. Descriptions are 45-50 chars; baseline is 194 chars. LLMs cannot distinguish between get_metar (current conditions) vs get_taf (forecast) vs get_route_weather (multi-airport) without richer guidance.
No documented output schemas. Source code shows tool definitions but no visible return type documentation. LLMs cannot plan downstream operations or extract required fields (e.g., does get_metar return wind_speed, temperature, visibility?).
Numeric parameter 'radius' in get-pireps lacks min/max bounds. No constraint stated; LLM could pass 0, negative, or absurdly large values (e.g., 999999 miles).
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 55 | 2026-07-28+ | v2 |
No error handling guidance in tool descriptions. If an airport code is invalid or no data exists, what should the LLM do? Descriptions do not mention recovery paths (e.g., 'Try a nearby airport' or 'Check if the code is valid').
Enum values in get-sigmets and get-gairmets lack descriptions. 'conv', 'turb', 'ice', 'ifr' are aviation acronyms; LLMs may not know these mean convective, turbulence, icing, instrument flight rules. Descriptions should expand acronyms.