9 tools with complete schemas and Chinese descriptions, but significant quality gaps. All tools are READ_ONLY (good for safety), but descriptions are minimal (10-20 chars), parameter descriptions lack depth, and no output schemas are documented. Tool names follow verb_noun pattern (search_, query_, get_) which is correct. However, descriptions are too terse to guide LLM selection effectively. No error handling guidance, no pagination info for list-like tools, and no chaining IDs documented in responses. Schemas present but sparse, most parameters lack constraints (enums, ranges, formats). This is typical of a domain-specific tool set that prioritizes functionality over LLM usability.
按文档 ID 获取单篇文档。
查询债券收益率时间序列。
查询回购定盘利率。
查询人民币汇率中间价。
查询银行间市场利率时间序列。
查询宏观经济指标。
查询 Shibor。
按金融实体精确检索样例文档。
Descriptions are critically short (10-20 chars). LLMs cannot distinguish when to use search_reports vs search_by_entity, or which query_* tool to call. Expand to 50-200 chars explaining WHAT, WHEN, and WHAT IT RETURNS.
No output schemas documented. LLMs cannot plan downstream calls or extract fields. Document what search_reports returns (e.g. list of {doc_id, title, date, snippet}), what query_interest_rate returns (e.g. {rate_type, dates[], values[]}), etc.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 46 | 2026-07-28+ | v2 |
搜索金融研报、政策文件和知识片段。
Parameter descriptions are missing or generic. 'query' in search_reports lacks guidance on format/length. 'rate_type' in query_interest_rate has no enum or examples. 'doc_type' filter is undocumented. Add constraints and examples to every parameter description.
No pagination or result limits documented. search_reports and search_by_entity accept top_k/limit but no guidance on max values, whether results are sorted, or how to fetch next page. Add 'Returns up to N results; use offset/cursor for pagination.'
No error handling guidance. If query_interest_rate fails (invalid rate_type, date range error, service down), LLM has no recovery path. Add error classification and recovery hints to descriptions.