Loading ToolBench
Distributed AI agent coordination with persistent collective memory across infrastructure networks. Provides MCP server hosting, memory management, and remote MCP access via HTTP.
Scoring was not performed
Tool names do not follow verb_noun pattern. 'hello_world' and 'get_server_info' lack clear action semantics; 'hello_world' in particular is not descriptive of its function.
Descriptions are too short (10-45 chars vs baseline 194 chars). No guidance on WHEN to call each tool, WHAT it returns, or dependencies. LLMs cannot distinguish these tools from similar ones.
No documented output/return schemas. Tools return raw strings; callers cannot predict field names, types, or structure. Violates pattern:response-shaper.
No error handling visible. No guidance on recovery, retryability, or what to do if a call fails. Violates pattern:recovery-guide.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-22 | F | 24 | 2026-07-28+ | v2 |
| 2026-03-09 | F | 43 | - | v1 |
Parameter 'name' in hello_world lacks format constraints. No enum, no min/max length, no pattern. LLMs may pass invalid or unexpected values.
add_numbers accepts unbounded float parameters with no min/max declared. LLMs could pass extremely large numbers, NaN, or infinity without validation guidance.