Agentic developer-productivity assistant: reads a GitHub issue, plans a fix, writes code + tests, opens a draft PR — via a planner/coder/reviewer multi-agent LangGraph.
Three tools with clear verb-noun naming (get_issue, fix_issue, run_status) and basic descriptions. All tools have input schemas with typed parameters and descriptions. However, descriptions are minimal (10-60 chars), lacking context on WHEN to use each tool, prerequisites, or recovery guidance. Output schemas are not documented, LLMs cannot predict response structure. No error handling guidance (e.g., what to do if a run fails or times out). Missing idempotency hints for fix_issue, which is a destructive operation. Parameter descriptions are sparse: 'repo is owner/name' is terse; base_branch lacks guidance on defaults or format.
Start the full pipeline for an issue: plan -> code -> test -> review -> draft PR. Returns a run_id; poll with run_status.
Fetch a GitHub issue (title, body, labels, url). repo is 'owner/name'.
Get the status of a fix run (status, pr_url, error, iteration).
Output schemas not documented. LLMs cannot predict response structure (fields, types, nested objects). Agents must guess what fields exist in run_status response or issue data.
Descriptions are too brief (10 - 60 chars). Missing WHEN to use each tool, prerequisites, and recovery guidance. E.g., fix_issue description does not explain that it returns immediately with run_id and requires polling run_status.
fix_issue is a destructive operation (creates PR, modifies repo) but lacks error handling guidance. No recovery instructions if the pipeline fails mid-execution. LLM cannot determine if retry is safe or if manual intervention is needed.
Parameter descriptions lack format/constraint details. 'repo is owner/name' is terse; base_branch has no guidance on valid values, defaults, or format. LLMs may pass invalid repo formats or branch names.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 49 | 2026-07-28+ | v2 |
No idempotency or confirmation pattern for fix_issue. Agents may accidentally trigger multiple fix runs for the same issue if they retry without understanding the operation is non-idempotent.