Force agents to report claims in evidence-gated tiers (FACT / INFERENCE / SPECULATION / UNVERIFIED). Deterministic, no-LLM.
Server has 4 tools with clear, domain-specific purposes (claim verification). All tools have descriptions (50-150 chars, within baseline 34-392 range). Input schemas are present and typed. However, parameter descriptions are minimal or absent for several inputs, and output schemas are not formally documented. Error handling is basic, no recovery guidance or actionable error messages. The deterministic, no-LLM design is sound, but tool composition could be tighter (tier_claim and check_claim overlap in intent).
Scan a claim string for fabrication/hedging signals (deterministic, no-LLM). Returns the matched signals + a prelim verdict. Lower-level than tier_claim; use when you only have the claim text, no evidence yet.
Return the canonical completion-report shape (STATUS / EVIDENCE / GAPS) and the outline of the evidence-tier loop, so any agent can format an honest completion report consistently.
Classify a claim into an evidence tier (FACT / INFERENCE / SPECULATION / UNVERIFIED) based on the attached evidence and verification kind. Returns the tier, its definition, a verdict (TRUST / REVIEW / DO-NOT-REPORT), and an honest next-action. Use before reporting any outcome to a user.
Return the FACT/INFERENCE/SPECULATION/UNVERIFIED definitions.
Output schemas not formally documented. tier_claim and check_claim return dicts with fields like 'tier', 'verdict', 'signals', but LLMs cannot see the structure in advance. Add explicit return type annotations or schema definitions.
Parameter descriptions are missing or minimal. 'claim' param in tier_claim has a description, but 'evidence' and 'verification_kind' have only 1-2 word descriptions ('Evidence supporting the claim (optional)'). LLMs need explicit guidance on format, constraints, and when to use each.
Overlapping tool intent. tier_claim and check_claim both scan claims for signals. check_claim is described as 'lower-level' but the distinction is unclear to an LLM. Consider merging or clarifying when to call each.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 52 | 2026-07-28+ | v2 |
No error handling or recovery guidance. If a claim is malformed or evidence is unparseable, the tools return a result but do not guide the agent on what to do next. Add error classification (retryable, user-fixable, fatal) and actionable messages.
report_templates and tier_definitions take no parameters and return static data. These are better served as documentation or a single discovery tool (e.g., 'get_verification_schema') rather than two separate tools. Reduces cognitive load on the LLM.