Circuit breakers for AI: brake stops dangerous actions, redteam provides adversarial rebuttal, thrift optimizes token usage. Multi-package monorepo with MCP servers, CLI tools, and LangChain integration.
The Lyceum server has severe definition quality gaps. Tool descriptions are present but vague and lack actionable context for LLM selection. Input schemas are partially visible but lack proper type definitions and parameter descriptions. No output schemas are documented. Tools like 'challenge', 'rebut', and 'compactContext' have generic descriptions that don't explain WHEN to use them or WHAT they return. The 'options' parameter appears in multiple tools but is never defined, LLMs cannot infer its structure. Error handling is absent from all tool definitions. No tool declares its risk profile or side effects clearly in the description itself (risk labels exist in metadata but not in the description text LLMs read). The server conflates multiple concerns (e.g., 'challenge' scans claims, plans, AND code edits in one tool).
Audits and logs brake, redteam, and thrift actions for compliance and debugging
Scans claims, plans, and code edits for reasoning flaws, code drift, and crash risks with intelligent context compacting
Intelligently compacts context by deduplicating repeated reads, capping runaway results, and stripping machine noise
Cuts tokens an AI agent burns on tool output by deduplicating repeated reads, capping runaway results, and stripping machine noise
Detects dangerous patterns and conditions that should trigger the emergency brake
Provides adversarial rebuttal to claims and reasoning
Scans code for reasoning flaws, code drift, and crash risks
Emergency brake to stop a dangerous action immediately with 1000ms SLA
Undefined 'options' parameter across multiple tools (challenge, compactContext, compress). LLMs cannot infer structure, type, or valid keys. This forces guessing and causes tool misuse.
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields. Baseline: 100% of A+ tools document return types.
Descriptions lack WHEN/WHY context. 'Scans claims, plans, and code edits for reasoning flaws' does not explain when to call challenge vs rebut vs scanCodeFlaws. LLMs cannot disambiguate.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 38 | 2026-07-28+ | v2 |
No error handling guidance in any tool definition. If 'stop' fails to halt an action, what should the LLM do? If 'danger' returns false, is the action safe? No recovery paths defined.
Tool 'challenge' combines three concerns (claims, plans, code edits). Should be split into separate tools so agents can compose them independently. Violates single-responsibility principle.