Local coding agent runtime for Babel — chat, plan, and deep modes with TUI/REPL
Babel CLI exposes 22 tools with basic schemas and descriptions, but significant gaps limit production readiness. All tools have descriptions (10-50 chars, mostly terse), and input schemas are present with type definitions. However, descriptions lack LLM-optimization guidance (e.g., 'when to use', 'prerequisites', 'side effects'). Output schemas are undocumented, LLMs cannot predict return structures. Error handling is absent; no recovery guidance or categorization. Parameter descriptions are minimal (1-3 words). No enums for constrained inputs (e.g., 'format' in git_context, 'operation' in lsp). Composition is reasonable (single-responsibility tools), but chaining metadata is sparse. Security concerns: run_command and mcp_request are high-risk with minimal guardrails. Overall, this is a functional but immature tool set suitable for internal use, not production agent deployment.
Apply a patch to files
Wait for a background command to complete
Signal completion of the task
Get git context (status, diff, etc.)
Find files matching a glob pattern
Search for text patterns in files
List directory contents
Language Server Protocol operations
Output schemas undocumented. LLMs cannot predict return structures for any tool. No field descriptions, types, or pagination guidance.
Descriptions are terse (10-50 chars) and lack LLM-optimization guidance. Missing 'when to use', prerequisites, side effects, and recovery hints. E.g., 'Read a file from the workspace' does not explain when to call read_file vs read_range.
No enums for constrained inputs. 'format' in git_context, 'operation' in lsp, and 'model' in sub_agent accept free-form strings, inviting hallucinated values. Should declare valid options as enums.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 53 | 2026-07-28+ | v2 |
Make a request to an MCP server
Search for available MCP tools
Read a file from the workspace
Read a specific range of lines from a file
Execute a shell command
Perform semantic search across the codebase
Replace text in a file
Spawn a sub-agent for parallel investigation or mutation
Run tests
Write or update todo items
Fetch content from a URL
Search the web
Get a map of the workspace structure
Write or create a file
High-risk tools (run_command, mcp_request, sub_agent) lack error handling, recovery guidance, and permission gates. No dry-run or confirmation pattern for irreversible operations.
Parameter descriptions are minimal (1-3 words). E.g., 'File path to read' lacks format, length, or character restrictions. LLMs cannot validate inputs without explicit constraints.