Game/desktop binary integrity scanner that fingerprints executables, detects common packers/obfuscators, and diffs against a known-good baseline to catch tampering.
Three tools with clear, concise descriptions (60-90 chars each) and proper input schemas. All parameters are typed and described. However, output schemas are undocumented, LLMs cannot predict the JSON structure returned by each tool. No error handling guidance, no parameter constraints (enums/ranges), and no indication of idempotency or side effects. Tool names follow verb_noun pattern but lack specificity about what 'scan', 'baseline', and 'diff' return. Descriptions state WHAT but not WHEN to use or what to do with results.
Build a known-good baseline JSON from one or more local binaries.
Diff a local binary against a baseline JSON file; return tamper findings as JSON.
Fingerprint a local executable (format/arch/hashes/entropy/sections), detect packers/obfuscators, and return findings as JSON.
Output schemas not documented. LLMs cannot predict the JSON structure (fields, types, nesting) returned by scan, baseline, or diff. Forces LLMs to guess or hallucinate field names for downstream processing.
No error handling guidance. If a file is not found, not readable, or not a valid binary, tools return unstructured errors. LLMs receive no recovery hints (e.g., 'Check file path' or 'Ensure file is readable').
Descriptions lack WHEN-to-use context. 'Fingerprint a local executable' tells WHAT but not when an LLM should call scan vs baseline vs diff. No guidance on prerequisites or typical workflow.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 53 | 2026-07-28+ | v2 |
No parameter constraints. 'path' and 'baseline_path' accept any string; no validation hints (file must exist, must be readable, must be a binary). LLMs may pass invalid paths without guidance.
Tool names lack specificity. 'binhunt_scan' could return any analysis; 'binhunt_baseline' could mean create or load. Names do not clearly distinguish intent from similar tools or indicate what data structure is returned.