An agentic system with tool execution, policy enforcement, and approval workflows for controlled command execution
KGB Agent exposes 3 process management tools with CRITICAL gaps. Tool descriptions are present but minimal (10-50 chars, well below the 194-char baseline). Input schemas are visible but lack parameter descriptions entirely, the 'command' param in run_background_process has no guidance on format or constraints. No output schemas documented. Error handling is absent, no recovery guidance, no categorization of retryable vs fatal errors. The tool names are verb-based (run_, stop_, find_) but lack clarity on scope and side effects. No evidence of idempotency, permission gates, or audit trails for destructive operations (stop_background_process). STDIO transport caps overall quality.
Find the PID listening on a port.
Start a background process in a workspace cwd. Pass argv list or simple shell-free command string.
Stop a tracked background process by PID.
Parameter descriptions missing entirely. 'command' param in run_background_process has no guidance on format (array vs string), constraints, or examples. LLMs cannot infer whether to pass ['ls', '-la'] or 'ls -la'.
No output schemas documented. Callers do not know what fields to expect (e.g., does run_background_process return pid, status, output?). Breaks tool chaining and forces LLM guessing.
Destructive tool (stop_background_process) lacks error handling, confirmation step, or permission gate. No guidance on what happens if PID is invalid or already terminated. Agents cannot recover from failures.
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 38 | <=2025-11-25 | v2 |
Tool descriptions are 10 - 50 characters (well below 194-char baseline). 'Start a background process in a workspace cwd...' lacks WHEN to use, prerequisites, and side effects. LLMs cannot distinguish this from other process tools.
No idempotency guarantees. If run_background_process is retried, does it spawn a duplicate process? Agents need to know whether repeated calls are safe.