MCP server that provides access to Katalon documentation through Amazon Bedrock Knowledge Base retrieval
Single tool with basic structure but significant gaps. Tool name 'search_katalon_knowledge_base' follows verb_noun convention (+). Description is present but generic (47 chars, below 50-200 char baseline for LLM optimization). Input schema exists with 'query' parameter typed as string, but parameter lacks description explaining what constitutes a valid search query, format constraints, or examples. Output schema is not documented, callers cannot predict the structure of results. Error handling is minimal: errors are caught and logged server-side but not returned to the client with recovery guidance. No pagination support despite knowledge base searches likely returning variable result counts.
Search for Katalon documents from knowledge base
Parameter 'query' lacks description. LLMs cannot infer valid format, length constraints, or search syntax.
Output schema not documented. Callers cannot predict result structure (fields, types, pagination). Baseline: 100% of A+ tools document return types.
No pagination support. Knowledge base searches may return many results; unbounded responses risk context window exhaustion.
Error handling does not guide recovery. Errors are caught and logged server-side but not returned to client with actionable guidance.
Tool description is 47 characters (below 50-char minimum for LLM optimization). Lacks WHEN to use, prerequisites, or distinction from similar tools.
Inferred effective spec: 2026-07-28+.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 48 | 2026-07-28+ | v2 |