Loading ToolBench
CLI + MCP server that verifies Ed25519-signed compute-attestation records from any provider and reports what compute was actually run, by whom, and whether every signature checks out. Read-only reporting layer -- does not sign or generate attestations.
PaceProof exposes 5 tools with basic verb-noun naming (verify, report, ingest, dashboard, init). All tools have descriptions (avg 95 chars, within 10-1024 range). However, parameter descriptions are minimal or absent in several cases. Input schemas are present but lack depth, most parameters have type and description, but no enums, patterns, or constraints. Output schemas are not documented. Error handling is not visible in the tool definitions. The server is read-only (low risk), but lacks the structured output guidance and parameter validation rigor expected of production tools.
Render a single self-contained static HTML dashboard from a report.
Run a named adapter over the input and emit normalized canonical-schema records as JSONL.
Scaffold an example directory with a sample keypair and validly/invalidly signed example records.
Ingest and verify records at PATH, then aggregate into a summary report.
Verify Ed25519 signatures on every record found at PATH.
Output schemas not documented. LLMs cannot plan downstream tool calls or extract structured data from results.
Parameter 'adapter' lacks enum constraint. Free-form string invites hallucinated adapter names. Should declare valid adapters (jsonl, etc.) as enum.
Parameter descriptions are generic or missing context. E.g., 'adapter to use for reading input' does not explain what adapters are available or when to use each.
No error handling guidance visible. Tools do not document what errors can occur, whether they are retryable, or how to recover.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 53 | 2026-07-28+ | v2 |
Tool 'init' has a default parameter value ('path' defaults to './paceproof-example') but no guidance on side effects. Agents may not realize this creates a directory.