Agentic platform for API testing and security validation, where every outbound request passes through a permission-checked, SSRF-guarded, audited MCP tool layer.
Critical failures across all dimensions. Tool definitions are inferred from file references only, no explicit schema registration visible in source. No parameter descriptions, no input schemas, no output schemas documented. Descriptions are generic one-liners (10-20 chars) that fail to explain WHEN to use each tool or what it returns. Security-critical tools (http_request, deploy_service, app_lifecycle) lack permission gates, scope declarations, or audit trail guidance. No error handling patterns visible. Tool names are inconsistent: some use verbs (probe_*, run_*, parse_*), others are nouns (secret_scan, sast_scan). No evidence of idempotency, pagination, or composition patterns. This server is not production-ready.
Manage application lifecycle (start, stop, health check)
Extract abstract syntax tree information from source code
Search for patterns in source code
Scan configuration files for security issues
Audit dependencies for known vulnerabilities
Deploy a service to a cloud provider
Discover API routes and endpoints from source code
No input schemas visible for any tool. Cannot verify parameter types, constraints, or descriptions. All 21 tools fail schema validation.
Descriptions are generic one-liners (10-20 chars) that do not explain WHEN to use the tool, what it returns, or how it differs from similar tools. LLMs cannot make informed selection decisions.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 33 | 2025-06-18+ | v2 |
Read files from the local filesystem
Make HTTP requests to target APIs with permission checking and SSRF protection
Parse and extract operations from OpenAPI specifications
Probe for authentication and authorization vulnerabilities
Probe for CORS (Cross-Origin Resource Sharing) misconfigurations
Probe for missing or misconfigured security headers
Probe for open redirect vulnerabilities
Probe for SQL injection vulnerabilities
Probe for Server-Side Request Forgery (SSRF) vulnerabilities
Probe for cross-site scripting (XSS) vulnerabilities
Render security assessment reports
Execute a test case against a target endpoint
Perform static application security testing (SAST)
Scan for exposed secrets and credentials in source code
Security-critical tools (http_request, deploy_service, app_lifecycle, fs_read) lack permission gates, scope declarations, and audit trail guidance. No evidence of rate limiting or input sanitization against injection attacks.
No error handling patterns visible. Tools do not document retryability, user-fixable vs fatal errors, or recovery guidance. LLMs cannot determine next steps on failure.
Tool definitions are inferred from file references only. No explicit tool registration with schemas visible in source code.