Loading ToolBench
MCP server for Mailchimp email marketing platform integration, enabling campaign management and automation workflow control
MailchimpMCP has basic tool definitions with clear action verbs (list_, create_, send_, start_) and descriptions present for all 5 tools. However, critical gaps undermine production readiness: (1) Parameter descriptions are minimal or absent, create_campaign has 4 params with descriptions, but list_campaigns, send_campaign, list_automations, and start_automation have empty input schemas with no parameter guidance. (2) Output schemas are undocumented, tools return lists/dicts but LLMs cannot infer field structure. (3) Error handling is absent, mailchimp_request() raises generic exceptions without recovery guidance. (4) No pagination support despite list_campaigns and list_automations returning unbounded results. (5) Tool descriptions lack context on when to use each tool vs. alternatives. Average tool description ~80 chars (below 194-char baseline); parameter descriptions average ~40 chars where present. Naming is strong (verb_noun pattern), but schema and error handling are weak.
Create a new email campaign in Mailchimp (returns the new campaign's ID and details).
List all classic automation workflows in the Mailchimp account.
Retrieve all email campaigns in the Mailchimp account (returns basic info for each campaign).
Send a campaign that has been created (campaign must be ready to send).
Start all emails in a specified automation workflow (activating the automation).
Output schemas undocumented. list_campaigns, list_automations return lists; send_campaign, start_automation return strings. LLMs cannot infer field structure (e.g., does campaign object have 'id', 'name', 'status'?) or plan downstream tool calls. Breaks tool chaining.
No pagination support. list_campaigns and list_automations return unbounded results. If account has 500+ campaigns, response bloats context window and LLM reasoning degrades. No limit, offset, or cursor parameters.
Error handling absent. mailchimp_request() raises generic 'Mailchimp API error {status}: {detail}' exceptions. No recovery guidance for LLM (e.g., 'Campaign not found. Try list_campaigns() first.'). Agents cannot self-correct.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 50 | 2026-07-28+ | v2 |
Parameter descriptions missing or minimal. send_campaign and start_automation have single-param inputs with descriptions, but list_campaigns and list_automations have empty input schemas ({}). No guidance on what fields are returned or when to call each tool.
Irreversible operations (send_campaign, start_automation) lack confirmation or dry-run support. Agents can accidentally send campaigns or activate automations without safeguards. No idempotency guarantees documented.