Evidence-backed accessibility pre-audit for GitHub Actions and AI coding assistants, with review-ready HTML, Excel, JSON, and screenshot evidence.
Two tools with basic schemas but significant quality gaps. Tool names lack clear action verbs (audit, setup-github-workflow are vague). Descriptions are present but generic (audit: 108 chars, setup: 97 chars), below the 194-char baseline for production tools. Parameter descriptions exist but lack specificity: 'Comma-separated list' is vague; no format constraints, ranges, or examples. No output schema documented for either tool. Error handling absent, no guidance on retryability, user-fixable errors, or recovery paths. Missing idempotency hints for the WRITE tool. No tool annotations (readOnlyHint/destructiveHint). Schemas lack enum constraints for 'fail-on' parameter (should be constrained to: none|minor|moderate|serious|critical). Overall: functional but well below production baseline.
Run a WCAG 2.2 accessibility audit on one or more URLs using axe-core and Playwright
Generate and set up a GitHub Actions workflow for automated accessibility audits
Tool names lack action verbs. 'audit' and 'setup-github-workflow' are vague, LLMs cannot infer intent from names alone. Should be 'run_accessibility_audit' and 'create_github_audit_workflow'.
No output schemas documented. LLMs cannot plan downstream calls or extract results. Must document what 'audit' returns (violations, severity counts, URLs checked, etc.) and what 'setup-github-workflow' returns (workflow file path, status, etc.).
'fail-on' parameter accepts free-form strings. Should be an enum: ['none', 'minor', 'moderate', 'serious', 'critical']. Free-form invites hallucinated values.
No error handling guidance. If audit fails (network error, invalid URL, GitHub auth fails), LLM has no recovery path. Must include: retryable vs fatal errors, actionable error messages, and next steps.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 41 | 2026-07-28+ | v2 |
WRITE tool 'setup-github-workflow' lacks destructiveHint annotation and confirmation pattern. Agents should confirm before modifying GitHub repos. No idempotency guarantee stated.