GhostCheck exposes a single tool 'agencyauditor' with minimal definition quality. The tool name lacks a clear action verb (should be 'scan_files' or 'audit_agency'). Description is generic ('Scanner plugin for AgencyAuditor') and under 50 chars, providing no context for when/why an LLM should call it. Input schema is present but sparse: 'files' array and 'config' object lack detailed descriptions, type constraints, and usage guidance. No output schema is documented. No error handling guidance. The tool appears to be a thin wrapper around a CLI command with no LLM-specific optimization.
Scanner plugin for AgencyAuditor
Tool name 'agencyauditor' lacks action verb. Should be 'scan_files', 'audit_agency', or 'run_security_scan' to signal intent to LLM.
Tool description is 35 chars ('Scanner plugin for AgencyAuditor'), below 50-char minimum. Provides no context for when to call, what it returns, or prerequisites. LLM cannot determine if this is the right tool.
Input parameter 'config' is an untyped object with no description. LLM cannot infer what fields it accepts, what values are valid, or how to construct it. Should enumerate expected keys or provide schema.
No output schema documented. LLM cannot plan downstream actions or extract results. Should specify return type (object with fields like 'vulnerabilities', 'summary', 'status').
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 36 | 2026-07-28+ | v2 |
No error handling guidance. If scan fails (invalid file path, permission denied, timeout), LLM receives no recovery hint. Should document error cases and suggest next steps.