Dockerised Python execution environment for AI agents
Server has 4 tools with basic schemas and descriptions, but significant gaps limit production readiness. All tools have descriptions (10-60 chars, below ideal 50-200 char range) and input schemas with type definitions. However, parameter descriptions are minimal or missing context. No output schemas documented. Error handling is absent, tools do not guide recovery or categorize failures. No tool annotations (readOnlyHint, destructiveHint, idempotentHint) despite WRITE/REVERSIBLE risk levels. Naming is verb-forward (execute-*, install-*, cleanup-*) but descriptions lack WHEN/WHY context and do not explain state management or session lifecycle. Missing: pagination guidance, rate limits, permission gates, audit trail documentation, and recovery patterns.
Clean up a persistent session and its resources
Execute Python code in a persistent Docker container
Execute Python code in a transient Docker container
Install a Python package in a Docker container
No output schemas documented. LLMs cannot predict return structure, forcing them to guess field names and types for downstream tool calls or data extraction.
Tool descriptions are too brief (30-60 chars vs. baseline 194 chars). Missing WHEN to use, prerequisites, and state management semantics. E.g., execute-persistent does not explain session lifecycle or how state persists.
No error handling guidance. Tools do not indicate what errors are retryable, user-fixable, or fatal. No recovery hints (e.g., 'If Docker is unavailable, check server logs').
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 46 | <=2025-11-25 | v2 |
Missing tool annotations despite WRITE/REVERSIBLE risk levels. No destructiveHint on cleanup-session or idempotentHint on execute-transient. Agents cannot reason about retry safety or side effects.
Parameter 'state' in execute-transient lacks type detail. Described as 'Optional state dictionary' but no schema for object properties, constraints, or serialization format.