A C++ agent runtime with tool execution, streaming chat protocol handling, and UI state management for agentic workflows
Agentty defines 22 tools with basic schemas and descriptions, but falls short of production quality. Most tools have 1-2 sentence descriptions (avg ~40 chars, well below the 194-char baseline) that lack context for LLM selection. Parameter descriptions are minimal or absent. No output schemas are documented. Critical tools like 'bash' and 'write' lack error handling guidance. Tool names are reasonable (verb-noun style) but descriptions do not explain WHEN to use each tool or what happens on failure. Schemas are present but sparse, many parameters lack type constraints or validation hints. No evidence of idempotency, pagination, or composition patterns.
Execute bash commands in the workspace
Run diagnostics on the workspace
Edit file contents with line-based modifications
Find definition of a symbol in code
Remove information from memory
Show git diff output
Show git commit log
Show git repository status
Find files matching a glob pattern
Descriptions are too brief (avg ~40 chars vs 194-char baseline). Most lack context for LLM selection, prerequisites, or consequences. E.g., 'Execute bash commands in the workspace' does not explain when to use bash vs grep, or that it is irreversible.
No output schemas documented. LLMs cannot plan downstream calls or extract required fields. E.g., does 'read' return {content, lines_read, encoding}? Does 'search_docs' return {results: [{id, score, text}], total}?
Destructive/irreversible tools (bash, write, edit, wipe, task, skill) lack error handling guidance and confirmation patterns. No indication of retryability, side effects, or recovery steps.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 46 | 2026-07-28+ | v2 |
Search for patterns in files
List directory contents
Move or rename a file
Read file contents with optional offset and line limit
Store information in memory for later retrieval
Search documentation using RAG pipeline
Execute or manage agent skills
Execute a task using the subagent loop
Manage todo items
Fetch content from a URL
Search the web for information
Clear all memory
Write content to a file
Parameter descriptions are minimal or absent. E.g., 'bash' command param has no length limit, timeout hint, or safety guidance. 'edit' start/end params lack clarity on 1-based vs 0-based indexing.
No pagination or result limits documented. Tools like 'grep', 'glob', 'git_log', 'search_docs' could return thousands of items, risking context window exhaustion. No limit, offset, or cursor parameters visible.