Loading ToolBench
MCP server that provides current weather information for specified locations using the Open-Meteo API
Single tool with adequate naming and comprehensive schema, but parameter descriptions are minimal and generic. The tool definition is clearly visible in source code (open_meteo_mcp.py, @mcp.tool() decorator on get_current_weather function). Description is present (125 chars, within 10-1024 range) but lacks context for LLM selection. Input schema is well-formed with string type and basic description. Output schema is documented via Pydantic WeatherResponse model. Error handling returns structured error objects, but lacks recovery guidance. No parameter-level validation rules documented in descriptions. Tool follows single-responsibility principle (gets weather for a location). Missing: explicit constraints on location format, guidance on when to use this vs other weather sources, and no mention that this is a READ_ONLY operation in the description itself.
Gets the current weather for a specified location. It first finds the latitude and longitude for the location, then fetches the current weather conditions.
Parameter description lacks format guidance and constraints. The 'location' parameter accepts only 'name' per geocoding API docs, but no constraint is documented in the parameter description. LLMs may attempt to pass coordinates or location IDs.
Tool description does not explain prerequisites or when to use it. Missing: 'Call this to fetch current conditions (temperature, wind, weather code) for any location worldwide. Requires only a location name.'
Output schema documentation is present (Pydantic model) but not exposed in tool registration. FastMCP may infer output from return type hint, but explicit JSON Schema output description in the tool definition would improve clarity for LLMs.
Error messages are structured but lack recovery guidance. When location not found, returns {'error': f'Could not find location: {location}'} with no suggestion to try alternative names or see available locations.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-22 | D | 52 | 2026-07-28+ | v2 |
| 2026-03-09 | F | 45 | - | v1 |