Loading ToolBench
Two minimal tools with bare-bones definitions. Both have descriptions (10-20 chars, below the 34-char p10 baseline), no parameter descriptions despite having parameters, and no documented output schemas. hello_world has an empty input schema; reverse_string has one typed parameter but lacks description. No error handling, no composition guidance, no security considerations. This is a demo/tutorial server, not production-grade.
Simple Hello World tool.
Takes a string and returns its reverse.
reverse_string parameter 'text' has type but no description. LLMs cannot infer what 'text' controls or expected format.
Both tool descriptions are under 20 characters ('Simple Hello World tool.' = 24 chars, 'Takes a string and returns its reverse.' = 39 chars). Descriptions lack WHEN to use, prerequisites, or return value details.
No output schemas documented. LLMs cannot plan downstream calls or extract fields. Both tools return dicts but structure is not formally declared.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 36 | 2026-07-28+ | v2 |
No error handling or recovery guidance. If reverse_string receives null or non-string input, no actionable error message guides the LLM to retry or correct.