Multi-agent AI system with dynamic tool creation, MCP server integration, and sandbox execution. Supports runtime tool registration, external MCP server connections, and agent configuration.
27 tools with mixed quality. Most have basic descriptions (50-150 chars) and input schemas present, but lack depth. Parameter descriptions are minimal or missing context. No output schemas documented. Error handling is absent, tools return raw errors without recovery guidance. Security concerns: run_command and browser_evaluate expose code execution without sanitization hints. No tool annotations (readOnlyHint, destructiveHint, idempotentHint). Naming is generally verb-first (good), but some tools like 'delegate_task' and 'browser_evaluate' are vague about side effects. Composition is reasonable, tools are mostly single-purpose, but chaining is not documented (e.g., web_search returns results, but no indication if they include URLs for web_fetch).
Click an element in the browser.
Close the browser instance.
Execute JavaScript in the browser context.
Extract content from the browser page.
Fill a form field in the browser.
Get the current page content from the browser.
Launch a browser instance.
Navigate to a URL in the browser.
Take a screenshot of the browser.
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields. E.g., web_search returns results but no indication of field structure (url, title, snippet, etc.).
run_command and browser_evaluate expose arbitrary code execution without sanitization guidance or injection warnings. No mention of input validation, command escaping, or script safety constraints.
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). LLMs cannot distinguish safe reads from irreversible writes. E.g., kill_process and write_file lack destructiveHint; browser_navigate lacks idempotentHint.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 46 | 2026-07-28+ | v2 |
Wait for an element or condition in the browser.
Create a new directory.
Delegate a task to another agent.
Get the current runtime agent configuration overrides.
Get metadata about a file.
Terminate a process by ID.
Search the knowledge base.
List directories the agent is allowed to access.
List contents of a directory.
List running processes.
Move or rename a file.
Read the contents of a file.
Execute a shell command with optional working directory, timeout, and environment variables.
Search for files matching a pattern.
Update runtime agent configuration. Only approval_mode and network_enabled are allowed. Changes apply to the NEXT goal execution (not the current one).
Fetch and parse content from a URL.
Search the web using DuckDuckGo.
Write content to a file.
Parameter descriptions are minimal (10-30 chars) and lack constraints. E.g., 'timeout' has no units or range; 'selector' has no CSS selector syntax guidance; 'pattern' in search_files has no regex/glob clarification.
No error handling guidance. Tools return raw errors without recovery hints. E.g., 'File not found' vs 'File not found. Check path with list_directory() or list_allowed_directories().'