The operating system for agentic businesses — a multi-tenant, multi-agent orchestration platform with memory consolidation, security, billing, and deployment capabilities
Two tools with partial schemas and minimal descriptions. claw_execute has a detailed input schema with 6 parameters (code, model, tools, maxTokens, sandbox, timeout) but description lacks actionable context about safety, reversibility, or error recovery. claw_undo has minimal schema (only executionId) and vague description. Neither tool documents output structure, error cases, or recovery guidance. No tool annotations (readOnlyHint/destructiveHint/idempotentHint). Naming is verb-based but descriptions fall short of LLM-optimization baseline (194 chars avg). Risk labels present but not integrated into descriptions.
Execute code safely and auditably via ClawCode harness. All code execution is logged, reversible, and sandboxed.
Undo a previous code execution
claw_undo description is 35 chars ('Undo a previous code execution'), below 20-char hard floor for scoring. No guidance on what 'undo' means, what state is restored, or error cases.
No output schemas documented for either tool. LLMs cannot plan downstream calls or extract execution results. claw_execute must return executionId, status, output, and error details; claw_undo must return success confirmation and state delta.
claw_execute description lacks error recovery guidance. No mention of what happens on timeout, sandbox violation, or invalid code. Agents cannot self-correct without actionable error messages.
No tool annotations (destructiveHint, idempotentHint, readOnlyHint). claw_execute is marked IRREVERSIBLE but this is not encoded in schema. claw_undo is REVERSIBLE but agents cannot detect this from metadata.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 43 | 2026-07-28+ | v2 |
Parameter 'tools' in claw_execute accepts array of strings but no enum constraint or validation. LLMs may hallucinate tool names like 'delete_all_files' or 'sudo_command'. Should enumerate allowed tools: [read_file, write_file, run_command, git_commit, github_api, linear_api].