Weather service providing alerts and forecasts via National Weather Service API
Two tools with basic verb-noun naming (get_alerts, get_forecast). Both have short descriptions (34-40 chars, below the 50-200 char baseline for LLM-optimized descriptions). Input schemas are present with typed parameters and descriptions. However, output schemas are completely undocumented, tools return plain strings with no structured format guidance. No error handling guidance, no pagination support, no output field documentation. Descriptions lack context on when to use each tool or what data structure is returned. Parameters are minimally described.
Get weather alerts for a US state.
Get weather forecast for a location.
Output schemas completely undocumented. Both tools return plain strings with no structured format guidance. LLMs cannot plan downstream operations or extract specific fields.
Descriptions are too short (34-40 chars vs 50-200 char baseline). Lack context on when to use each tool, what data is returned, or how to interpret results. Insufficient for LLM tool selection.
No error handling guidance. Tools return generic strings like 'Unable to fetch alerts' with no recovery hints. LLMs cannot determine if errors are retryable or what to do next.
No pagination support. get_alerts returns all active alerts for a state with no limit or offset parameters. Large result sets will blow context windows.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 44 | 2026-07-28+ | v2 |
Parameter descriptions are minimal. 'US state abbreviation (e.g., 'CA')' includes an example value that LLMs may reuse literally. Use enum constraint instead.