Trace AI agent execution: every tool call, every error, every dollar. Open source agent observability for Claude, Cursor, opencode, and any MCP-compatible agent. Local-first, free forever.
Agent-observability defines 6 tools with explicit schemas and descriptions. However, critical gaps limit production readiness. Most tool descriptions are adequate (100-150 chars), but parameter descriptions are sparse or missing entirely. Input schemas are present but lack depth: many parameters have no type constraints, enums, or validation guidance. Output schemas are completely undocumented, LLMs cannot predict what fields to expect from responses. Error handling is minimal; no recovery guidance or actionable error messages. The tools follow a session-tracking pattern but lack composition clarity and idempotency guarantees. Naming is clear (verb_noun style), but parameter naming inconsistencies (e.g., 'description' vs 'taskDescription') and missing type suffixes reduce clarity.
Check the current session status — tool call count, error count, grade estimate, and session duration
End an agent observability session and compute the grade
Get the most recent session's summary including grade, errors, and cost
Get aggregate stats across all sessions — total sessions, total tool calls, total cost, grade distribution
Log a tool call made by the agent for observability tracking
Start a new agent observability session to track tool calls, tokens, and errors
Output schemas completely undocumented. LLMs cannot predict response structure (fields, types, nesting). Forces agents to guess or fail on parsing.
Parameter descriptions missing or minimal. 'input', 'output', 'status', 'errorMessage' lack guidance on format, constraints, or valid values. LLMs cannot validate inputs before calling.
No error handling guidance. Tools return raw results but do not document failure modes, recovery steps, or actionable error messages. Agents cannot self-correct on failures.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 51 | 2025-06-18+ | v2 |
Parameter type constraints missing. 'status' enum is declared but 'sessionId', 'toolName', 'durationMs' lack min/max, format, or length constraints. Unbounded inputs risk invalid data.
Idempotency not declared. 'log_tool_call' and 'end_session' modify state but do not guarantee idempotent behavior. Agents retrying on ambiguous failures risk duplicate logs or session corruption.