A web-based playground for interacting with Agent Application Protocol (AAP) servers. Allows users to connect to AAP agents, manage client and server tools, handle tool permissions, and view conversation history with streaming support.
Single tool 'calculator' has a basic schema and description but critical gaps prevent production use. Description is minimal (44 chars, below 50-200 char baseline for LLM optimization). Input schema is present with proper JSON Schema structure, but lacks parameter-level descriptions, the 'expression' parameter has a description but no type validation beyond 'string'. No output schema documented. Tool uses eval() which is a severe security risk. No error handling guidance. No idempotency or confirmation pattern for a tool that modifies nothing but could fail unpredictably.
Perform basic arithmetic operations
Tool description too short (44 chars). LLM-optimized descriptions should be 50 - 200 chars. Current: 'Perform basic arithmetic operations' lacks context on when to use, what it returns, or error cases.
No output schema documented. LLMs cannot plan downstream calls or extract results without knowing the return type. Must document: returns string, format (e.g., numeric result or error message), example output.
Critical security flaw: tool uses eval(input.expression) which is vulnerable to code injection. Agents can be tricked via prompt injection to execute arbitrary JavaScript. Replace with a safe expression parser (e.g., math.js, expr-eval).
No error handling or recovery guidance. If eval() throws (e.g., 'undefined variable'), the error message is raw and unhelpful to the LLM. Must catch errors and return: 'Invalid expression: <detail>. Supported operators: +, -, *, /, %, ^, parentheses.'
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 40 | 2026-07-28+ | v2 |
Tool name 'calculator' is generic and does not start with an action verb. Rename to 'evaluate_expression' or 'compute_math' to clarify intent and match verb_noun convention (90% of A+ tools start with action verbs).