Evidence-backed capability packaging layer for cross-runtime agents. MCP server that provides tools for session management, capability promotion, portability, health checks, and validation.
19 tools with complete schemas and descriptions, but quality is uneven. Naming follows verb_noun convention well (start_session, record_event, finish_session). Descriptions are present but often generic (50-100 chars, below the 194-char baseline). Parameters have types and descriptions, but lack constraints (enums, ranges, patterns). No output schemas documented. Error handling is minimal, no recovery guidance or categorization. Security concerns: sessions_dir and evidence_dir exposed as parameters across all tools, forcing clients to manage paths. No idempotency hints or confirmation patterns for destructive operations (promote_capability, export_capability, adapt_capability).
Adapt a capability for a different runtime or model
Generate a capability card summarizing key information
Explain the contents and purpose of an artifact
Export a capability package for use in other projects
Mark a session as complete with an outcome
Check the health and status of a capability
Import a capability package from a bundle
Inspect detailed information about a capability
Descriptions are generic and under-optimized for LLM selection. Most descriptions are 50-100 chars (baseline 194 chars). E.g., 'health' = 'Check the health and status of a capability' lacks WHEN to use it or what it returns. LLMs cannot distinguish between health, inspect_capability, and validate_capability.
No output schemas documented. Tools return StrictModel subclasses but LLMs cannot see what fields to expect. This breaks tool chaining, e.g., start_session returns a session_id, but no schema tells the LLM what field name to use in downstream record_event calls.
Path parameters (sessions_dir, evidence_dir, capabilities_dir, eval_dir) exposed across all tools. This violates secret-injection and configuration patterns, clients must manage directory paths, increasing complexity and error surface. Should be server-side configuration.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 53 | 2026-07-28+ | v2 |
List all available capabilities in the registry
Convert a completed session into evidence artifacts
Promote evidence into a reusable capability package
Record an artifact produced in a session
Record a decision made during a session
Record an event in an active OMF session
Record context input in a session
Record a validation/test result in a session
Remap a capability to different tools or contexts
Start a new OMF session to track agent work
Validate a capability package against requirements
No parameter constraints (enums, ranges, patterns). E.g., 'outcome' in finish_session accepts any string, should be enum [success, failure, partial, cancelled]. 'skill_style' in export_capability has no enum. LLMs hallucinate invalid values.
Destructive operations (promote_capability, export_capability, adapt_capability, remap_capability) lack confirmation or dry-run patterns. No error handling guidance. Agents can silently corrupt capability packages without recovery paths.