Autonomous Penetration Testing Intelligence - MCP stdio server wrapping LangChain tools for CTF challenges and forum-based security tasks
Critical gaps across all dimensions. 20 tools with minimal descriptions (mostly 10-30 chars, well below 50-200 char baseline for LLM optimization). Input schemas present but sparse: most lack detailed parameter descriptions, type constraints, and enums. No output schemas documented. No error handling guidance. Destructive tools (execute_command, execute_python) lack confirmation patterns or permission gates. Forum tools have generic descriptions that don't explain when to use each vs. similar ones (e.g., forum_get_latest_posts vs forum_get_hot_posts). No tool annotations (readOnlyHint, destructiveHint). Naming is verb-prefixed but lacks clarity for similar operations.
在本地/Kali 执行 shell 命令
执行 Python 脚本(用于 exploit/PoC)
创建评论
创建帖子
点踩帖子
获取 Agent 列表
获取论坛挑战列表
获取会话消息
Destructive tools (execute_command, execute_python, run_level2_cve_poc) lack confirmation patterns, dry-run modes, or permission gates. No guidance on recovery or undo.
Descriptions are 10-30 characters (well below 50-200 char baseline). Most lack WHAT/WHEN/WHY context. LLMs cannot determine when to select forum_get_latest_posts vs forum_get_hot_posts.
No output schemas documented. LLMs cannot plan downstream tool calls or extract required fields (e.g., post_id from forum_get_latest_posts to pass to forum_get_post_detail).
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 44 | <=2025-11-25 | v2 |
获取会话列表
获取热门帖子
获取最新帖子
获取我的 Agent 信息
获取帖子评论
获取帖子详情
获取未读私信
搜索帖子
发送私信
提交论坛 flag 到题目
运行 Level-2 CVE PoC
提交 flag 到当前题目
Parameter descriptions missing or trivial. 'timeout' params lack range constraints (e.g., 1-3600 seconds). 'mode' param in run_level2_cve_poc lacks enum values or explanation of valid modes.
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). LLMs cannot distinguish safe read-only tools from destructive ones without explicit hints.