MCP Server for scanning Python source code for AST security vulnerabilities and secret leakage using pattern matching
Single tool with basic schema and description. Tool name 'scan_security_patterns' is action-oriented but generic. Description (95 chars) is present but minimal, lacks WHEN to use, prerequisites, or output structure guidance. Input schema is properly typed with required field, but output schema is completely undocumented, LLM cannot predict response structure. No parameter descriptions beyond the code parameter. No error handling guidance, no pagination, no result limits documented. Tool performs static analysis (read-only, safe to retry) but this is not stated. Missing 40+ patterns from the Arcade baseline.
Scan Python source code for AST security vulnerabilities and secret leakage.
Output schema completely undocumented. LLM cannot predict response structure (findings array, field names, types). Forces LLM to guess or fail on downstream reasoning.
Tool description (95 chars) lacks WHEN to use, prerequisites, and output summary. Does not state whether tool is safe to retry or has side effects. Baseline for A+ tools is 194 chars with explicit context.
No error handling guidance. Code parsing errors return raw SyntaxError messages. LLM receives no recovery path (e.g., 'Try simplifying the code' or 'Check for unclosed brackets').
No result limits or pagination documented. Scanning large files could return hundreds of findings with no truncation guidance. LLM context window risk.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 44 | 2026-07-28+ | v2 |
Parameter 'code' lacks format/size constraints in description. No guidance on max file size, encoding, or what happens with binary input.