A full-stack AI chat application with plugin/MCP tool support, featuring admin console, chat client, and backend service with unified tool orchestration
Single tool 'web_search' with significant quality gaps. Description is in Chinese (non-standard for LLM tooling) and lacks English clarity. Input schema present but parameters lack proper type constraints and validation guidance. No output schema documented. No error handling guidance. Tool naming is acceptable but descriptions do not meet LLM-optimization baselines (194 chars avg for A+ tools). Parameter descriptions are minimal and lack format/constraint details required for reliable LLM invocation.
搜索网络获取实时信息,如天气、新闻、股价、时间、位置信息等。请同时提供搜索关键词和搜索目的说明。
Tool description in Chinese only; LLMs trained primarily on English struggle with non-English descriptions. Reduces discoverability and selection accuracy.
No output schema documented. LLMs cannot plan downstream operations or extract structured data from results. Violates pattern:tool baseline (100% of A+ tools have documented return types).
Parameter 'query' lacks format constraints, length limits, or examples. Parameter 'explanation' lacks guidance on required verb forms or length. Descriptions under 72 chars avg (baseline 72 chars for A+ tools).
No error handling guidance. Tool does not document what happens on network failure, rate limiting, or invalid queries. LLM has no recovery path.
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 44 | <=2025-11-25 | v2 |
Tool marked READ_ONLY but no idempotentHint or readOnlyHint annotation present in schema. Missing tool annotations required by current MCP spec.