Strata demonstrates solid fundamentals: all 5 tools have descriptions, proper naming conventions (verb-noun), and tool annotations present. However, critical gaps exist: input/output schemas are not visible in the provided source code, parameter descriptions are absent, and error handling guidance is minimal. The codebase shows good engineering practices (Zod validation, structured logging, TypeScript), but tool definitions lack the LLM-optimization detail required for A-grade quality. Schema visibility is the primary blocker, without seeing actual Zod shapes or JSON Schema definitions, schema scoring is severely constrained.
Delete a memory from the corpus
Test-only. Reports reachability so protocol behavior can be asserted.
Retrieve memories from the corpus using hybrid search
Store a memory in the corpus
Search memories by tags
Input and output schemas not visible in source. Tools register with Zod shapes (inferred from healthInputShape, healthOutputShape in probeTool.ts), but actual schema definitions are not provided. Cannot verify parameter types, descriptions, or constraints.
Parameter descriptions missing. Tool descriptions exist (e.g., 'Store a memory in the corpus'), but individual parameter documentation is absent. LLMs cannot infer what 'content', 'tags', or 'limit' parameters mean without explicit descriptions. Violates pattern:tool-description baseline: '100% of A+ tool params have descriptions.'
Error handling lacks recovery guidance. No evidence of actionable error messages (e.g., 'Memory not found. Try recall() with a broader query.'). Errors likely return raw exceptions rather than structured guidance. Violates pattern:recovery-guide.
Inferred effective spec: 2025-06-18+.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 38 | 2025-06-18+ | v2 |
Destructive tool (forget) lacks confirmation step. No evidence of dry-run or confirmation-before-execute pattern. Agents can delete memories irreversibly without a safety gate. Violates pattern:confirmation-request.
Tool 'probe' is test-only but ships in production registration. While intentionally test-scoped, its presence in the tool list dilutes agent selection of core tools (remember/recall). Per DD-018 comment, 'each additional tool measurably dilutes the agent's selection.' Consider gating probe registration to test environments only.