Weather server providing alerts and forecast data from the National Weather Service API
Two tools with basic verb-noun naming (get_alerts, get_forecast) and minimal descriptions. Both have input schemas with typed parameters and descriptions, meeting baseline requirements. However, descriptions are extremely brief (18-27 chars), falling well below the 50-200 char LLM-optimized range. No output schemas documented. No error handling guidance. No parameter constraints (e.g., state code validation, lat/lon bounds). Tool composition is reasonable but lacks depth for production use.
Get weather alerts for a US state.
Get weather forecast for a location.
Descriptions critically short (18-27 chars). LLMs cannot determine when/why to select tools. Baseline is 50-200 chars for LLM-optimized descriptions.
No output schemas documented. LLMs cannot plan downstream calls or extract required data without knowing response structure.
No parameter constraints. 'state' parameter accepts any string; should validate against 50 US state codes. 'latitude'/'longitude' lack bounds (±90, ±180).
No error handling guidance. If state code is invalid or coordinates out of range, LLM receives no recovery path.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 42 | 2026-07-28+ | v2 |
No pagination support. If alerts or forecast data is large, no limit/offset parameters to prevent context window exhaustion.