An inbox for asynchronous AI work, built on DeepAgents and LangGraph. Provides thread protocol, checkpoint-shaped state API, and MCP server integration for tools and skills.
The 'eval' tool is critically underdeveloped. No input schema is visible in the provided source code (apps/api-server/src/routes-tools.ts is referenced but not shown). The description 'Built-in evaluation tool for executing code' is generic (47 chars) and does not explain WHAT code is evaluated, WHEN to use it, or what the output structure is. No parameter documentation is visible. The tool is marked IRREVERSIBLE (destructive), yet there is no confirmation pattern, dry-run option, or permission gate documented. This violates multiple critical patterns: tool-description, constrained-input, confirmation-request, and secret-injection (code execution is a major security surface).
Built-in evaluation tool for executing code
Description is generic (47 chars) and does not explain what code is evaluated, expected input format, or output structure. Violates tool-description pattern.
Tool is marked IRREVERSIBLE but has no confirmation pattern, dry-run option, or permission gate. Code execution is a critical security surface requiring explicit safeguards.
No visible parameter descriptions or type constraints. LLMs cannot infer what inputs are valid or what format code must take.
Code execution tool exposes major injection and privilege escalation risks. No evidence of input sanitization, sandboxing, or audit logging in visible source.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 21 | 2026-07-28+ | v2 |