Distillation attack detection and supply chain security for AI models. Detects prompt injection attacks, chain-of-thought elicitation, capability mapping, safety boundary probing, tool use extraction, reward model grading, and censorship rewrite attacks using embedding-based and regex pattern matching.
Server defines 4 tools with basic descriptions and input schemas, but quality is inconsistent. Tool names lack clear action verbs (analyze_prompt vs get_threat_level). Descriptions are present but generic (avg ~80 chars, below 194-char baseline). No output schemas documented. Error handling absent. Security considerations for prompt analysis not addressed. Composition is reasonable (single responsibility per tool), but parameter documentation is severely deficient.
Analyze a prompt for distillation attack patterns. Returns threat level, category, signals, and similarity scores.
Analyze multiple prompts in batch. Returns threat assessments for each prompt.
Get the list of attack categories and their descriptions.
Get the list of meta-signals used for attack detection.
Parameter descriptions missing. 'prompt' and 'context' in analyze_prompt have descriptions, but 'prompts' array in batch_analyze lacks item-level guidance.
Output schemas not documented. Tools return threat assessments, categories, and signals, but response structure is not specified. LLMs cannot plan downstream calls or extract fields without knowing the output shape.
No error handling or recovery guidance. Tools lack descriptions of failure modes (e.g., invalid prompt format, API timeout, model unavailable).
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 47 | 2026-07-28+ | v2 |
Tool naming inconsistency. 'analyze_prompt' and 'batch_analyze' use different verb patterns. 'batch_analyze' is vague, does it analyze, score, or classify? Recommend 'analyze_prompts' (plural) for consistency and clarity.
No pagination or result limits documented. batch_analyze accepts an array of prompts but does not specify max size, result limits, or how to handle large batches.