A reusable operating framework for deliberate, verified AI-assisted product engineering.
FORGE defines 6 tools with clear verb-noun naming (forge_prepare, forge_metrics, forge_plan, forge_context, forge_run_status, forge_run_complete). All tools have descriptions (avg ~120 chars, within baseline 34-392 range). Input schemas are present with type definitions and descriptions for all parameters. However, output schemas are NOT documented, critical gap for LLM planning. Parameter descriptions are adequate but lack constraint details (ranges, enums, format specs). Error handling and recovery guidance are absent. Tool composition is sound (each does one thing), but descriptions could be more LLM-optimized per pattern:tool-description baseline.
Return the installed project's product, technical, experience, security, and operations context.
Summarize local packet reuse, preparation duration, deterministic work, and estimated context reduction without task text or source content.
Classify a task and return proportional capabilities, risk, approvals, workflow, and execution steps.
Perform bounded, model-free repository discovery and return reusable task context, risk, commands, and a model-tier hint.
Atomically record stage-specific evidence for every remaining workflow step. Required human approvals must already be resolved.
Return a named workflow run, or the latest run when no ID is supplied.
Output schemas not documented. LLMs cannot plan downstream tool calls or extract required fields without knowing what forge_prepare, forge_metrics, forge_plan, forge_context, forge_run_status, and forge_run_complete return.
Parameter descriptions lack constraint details. 'cwd' accepts 1-500 chars but no guidance on absolute vs relative paths or validation rules. 'task' accepts 1-4000 chars but no format hints (free text? structured JSON?). 'evidence' is an object with additionalProperties but no schema for values.
No error handling or recovery guidance. If forge_prepare fails (e.g., invalid cwd, unreadable repo), the LLM has no guidance on what to do next. Descriptions do not indicate which errors are retryable vs fatal.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 58 | 2026-07-28+ | v2 |
forge_run_complete is marked WRITE but lacks confirmation/dry-run pattern. Atomically recording evidence for all remaining workflow steps is irreversible, agents should be able to preview changes before committing.
No tool annotations visible in source. forge_run_complete is marked WRITE but readOnlyHint/destructiveHint/idempotentHint are not declared in schema, limiting LLM's ability to reason about side effects.