Single tool 'zulip' with minimal schema definition. Input schema is a bare string parameter ('command') with no type constraints, enums, or validation guidance. Description is 104 chars but lacks actionable detail on when/why to use the tool, what it returns, or error recovery paths. No output schema documented. Tool appears to accept free-form commands ('help' mentioned) without constraint or structure, inviting hallucinated inputs. No parameter descriptions beyond the command itself. Follows none of the 54 agentic patterns for tool composition, error handling, or LLM-optimized descriptions.
Read Zulip conversations. Give a Zulip URL to fetch nearby messages, or "help" for more options.
Input schema lacks type constraints and enums. 'command' parameter accepts arbitrary strings with no validation, inviting hallucinated commands like 'zulip fetch-all-messages' or 'zulip delete-conversation'. LLMs cannot infer valid command syntax from a bare string type.
No output schema documented. Tool description says 'Read Zulip conversations' but does not specify what fields are returned, whether results are paginated, or how to chain results into downstream operations. LLMs cannot plan multi-step workflows without knowing output structure.
Tool name 'zulip' is a noun, not a verb. Naming convention should be 'get_zulip_messages', 'fetch_zulip_conversation', or 'search_zulip_threads' to signal the action. Bare noun names force LLMs to guess intent.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 33 | 2026-07-28+ | v2 |
Description lacks WHEN/WHY guidance. 'Read Zulip conversations. Give a Zulip URL to fetch nearby messages, or "help" for more options.' does not explain when to call this vs other tools, what 'nearby' means, or what 'help' returns. LLMs need explicit selection criteria.
No error handling guidance. If a URL is malformed, credentials missing, or rate limit hit, the tool provides no recovery path. Error responses should guide LLMs: 'Invalid Zulip URL. Try search_zulip_channels() first to find valid URLs.'