MCP Server adapter that integrates core system and FastMCP with modular architecture
MCP-BOS exhibits significant quality gaps across all four evaluated tools. While basic schemas are present for all tools, descriptions are either missing entirely (server_info, hello, my_tool) or minimal (add). Parameter descriptions are present but generic. No output schemas are documented. Error handling is absent. Tool naming follows basic conventions but lacks clear action verbs in some cases. The codebase shows a template/starter implementation rather than production-grade tool definitions. Most tools score 30-40 due to missing or trivial descriptions.
两个整数的和相加
返回问候消息
自定义工具
获取服务器信息
Missing or trivial tool descriptions. server_info, my_tool have no English descriptions (only Chinese). hello has '返回问候消息' (trivial). LLMs cannot determine when/why to select tools without clear English descriptions stating WHAT the tool does, WHEN to use it, and any prerequisites.
No output schemas documented. Tools return unstructured or undocumented response shapes. LLMs cannot plan downstream tool calls or extract needed fields without knowing what the response contains.
my_tool has no clear action verb or purpose. Name is generic and vague. LLM cannot infer what this tool does from the name alone. Pattern requires verb_noun naming (e.g., get_, create_, search_).
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-21 | F | 34 | 2026-07-28+ | v2 |
| 2026-03-09 | F | 37 | - | v1 |
No error handling guidance. Tools provide no recovery hints, retryability classification, or actionable error messages. If a tool fails, the LLM has no direction on what to do next.
Parameter descriptions are generic or missing. 'name' in hello has a basic description; 'param' in my_tool is minimally described. Parameter descriptions must explain what the parameter controls and constraints (format, range, allowed values).
Mixed language in codebase. Tool descriptions and comments use Chinese. MCP servers must use English for all tool definitions, descriptions, and parameter documentation for LLM compatibility and accessibility.
No input validation. Tools accept parameters but do not validate ranges, formats, or constraints. E.g., add accepts integers but does not document min/max or behavior on overflow.