LLM-powered knowledge compilation pipeline with RAG chat, wiki indexing, and MCP integration. Combines Go REST/SSE API, Python AI engine, and React Web UI.
KaaS exposes a single tool 'ask' with a complete JSON Schema input definition and a clear, actionable description (89 chars). The tool accepts natural-language queries grounded in optional wiki paths, with model and knowledge-base overrides. Schema includes proper type declarations and parameter descriptions. However, the output schema is not documented, LLMs cannot predict the response structure (cited answer format, fields, pagination). No error handling guidance is provided. The tool is read-only (low risk), but lacks recovery hints for common failures (e.g., 'no relevant articles found'). Naming is generic ('ask') rather than verb-noun ('query_knowledge_base' or 'search_wiki'). Overall: solid foundation, but incomplete for production LLM integration.
Ask the compiled KaaS wiki a question; returns a cited answer.
Output schema not documented. LLMs cannot predict response structure (fields, types, pagination). Breaks downstream tool chaining and forces LLMs to guess field names.
Tool name 'ask' is generic and does not follow verb_noun convention. 'query_knowledge_base' or 'search_wiki' would be clearer and help LLMs disambiguate from other question-answering tools.
No error handling guidance. If no relevant articles are found, or if the model fails, the tool provides no recovery hints. LLMs need actionable error messages like 'No articles matched. Try: (1) broaden query, (2) specify paths explicitly, (3) check kb slug.'
Parameter 'paths' lacks constraints. Is it a list of file paths, URL slugs, or internal IDs? Description says 'wiki article paths' but does not specify format, length limits, or examples. LLMs may pass invalid values.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | C | 63 | 2026-07-28+ | v2 |
Parameter 'model' is a free-form string override with no enum or validation. LLMs may hallucinate invalid model names. Should list supported models or document the format (e.g., 'OpenAI model ID, e.g., gpt-4o').