Compute unit readiness (C-ratings style) from a personnel/equipment/training YAML and flag gaps.
Single tool 'readiness_scan' has a basic description (89 chars) and minimal schema. Input schema present but lacks detail: only 'target' parameter with generic string type and description. No output schema documented. No error handling guidance, no parameter constraints (e.g., file path validation, directory traversal protection), and no indication of what the JSON response structure contains. Tool name is verb-noun compliant but description does not explain WHEN to use it, WHAT the output fields mean, or HOW to interpret findings. Lacks production-grade rigor.
Compute unit readiness (C-ratings style) from a personnel/equipment/training YAML and flag gaps.. Returns JSON findings.
No output schema documented. LLM cannot predict response structure (fields, types, nesting). Requires reverse-engineering from code or trial-and-error.
Parameter 'target' lacks constraints. No validation rules (file vs directory, path traversal protection, max depth). Description does not specify format or allowed values.
Tool description (89 chars) is too generic. Does not explain WHEN to call it, WHAT 'C-ratings style' means, or HOW to interpret 'gaps' in the JSON response. LLM cannot determine if this is the right tool for a given task.
No error handling guidance. If scan fails (invalid path, permission denied, malformed YAML), LLM receives no recovery hint. No categorization of errors as retryable vs fatal.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 40 | 2026-07-28+ | v2 |
Security: 'target' parameter accepts arbitrary file paths. No documented protection against path traversal (e.g., '../../../etc/passwd'). Tool description does not clarify scope (local filesystem only? network paths?).