Loading ToolBench
Single tool 'calculator' has critical definition gaps. Tool name lacks action verb (should be 'add_integers' or 'compute_sum'). Description is minimal (10 chars) and does not explain WHEN to use it or WHAT it returns. Input parameters 'a' and 'b' have null descriptions, LLMs cannot infer meaning. No output schema documented. No error handling guidance. Naming violates verb_noun convention (baseline: 90% of A+ tools start with action verb). Parameter descriptions missing entirely (baseline: 100% of A+ tools have param descriptions).
A simple calculator function that adds two integers.
Tool name 'calculator' lacks action verb. Should be 'add_integers', 'compute_sum', or similar. LLMs infer intent from verb-noun names; 'calculator' is generic and ambiguous.
Tool description is 10 characters ('A simple calculator function that adds two integers.'), below 20-char minimum. Does not state WHEN to use it, WHAT it returns, or any prerequisites. LLMs cannot determine tool selection without context.
Input parameters 'a' and 'b' have null descriptions. Baseline: 100% of A+ tools have parameter descriptions. LLMs cannot infer that 'a' and 'b' are operands for addition vs. other operations.
No output schema documented. Tool returns an integer, but LLMs need explicit documentation of return type and structure to plan downstream calls and extract results correctly.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 25 | 2026-07-28+ | v2 |
No error handling or recovery guidance. If inputs are invalid (e.g., non-integer strings), tool provides no actionable error message. LLM cannot self-correct.