Weather information server providing alerts and forecasts via National Weather Service API
Two tools with basic verb-noun naming (get_alerts, get_forecast). Both have short descriptions (40-50 chars) and documented input schemas with type and description fields. However, descriptions lack context on WHEN to use each tool, prerequisites, or what the output structure contains. No output schema documentation. Error handling returns plain strings without recovery guidance. Parameters are minimally described (state: 'Two-letter US state code' is adequate but latitude/longitude lack range constraints). No pagination, no structured output, no error categorization.
Get weather alerts for a US state.
Get weather forecast for a location.
No output schema documentation. Tools return unstructured strings; LLMs cannot parse structured data or plan downstream calls. Rubric baseline: 100% of A+ tools document return types.
Descriptions too brief (40-50 chars). Missing WHEN to use, prerequisites, and output format. Rubric baseline: average tool description 194 chars; descriptions under 20 chars score 0-20. These are borderline.
No error recovery guidance. Tools return plain strings like 'Unable to fetch alerts' without suggesting next steps (e.g., 'Try a different state code' or 'Check network connectivity'). Rubric: error responses must tell LLM what to do next.
Numeric parameters lack constraints. latitude/longitude have no min/max bounds documented. Rubric: specify minimum and maximum for numeric parameters to prevent absurd values.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 48 | 2026-07-28+ | v2 |
No pagination or result limits. get_forecast hardcodes 5 periods; get_alerts returns all features. Rubric: cap results at reasonable limit (20-50) and offer pagination to avoid context window exhaustion.