Model Context Protocol server for Shopify Developer and Platform Changelogs
Server has 8 well-named tools with consistent verb_noun patterns (get_, search_, dev_, platform_). All tools have descriptions (avg ~120 chars, within baseline 34-392). Input schemas are present with type definitions and parameter descriptions. However, output schemas are not documented in the provided code, critical for LLM planning. Error handling is minimal; no recovery guidance or actionable error messages visible. Parameter constraints (e.g., days enum: 1,3,7,14,30) are documented in descriptions but not enforced as JSON Schema enums. No tool annotations (readOnlyHint, destructiveHint) despite all tools being READ_ONLY. Missing pagination documentation for list-like tools (dev_search, platform_search return 'up to 15' but no cursor/offset params visible).
Get breaking changes, deprecations, and migration notices from the Developer Changelog. Essential for maintaining API compatibility.
Get recent updates from the Developer Changelog. Specify days to look back (1, 3, 7, 14, or 30).
Search the Shopify Developer Changelog for API updates, deprecations, and technical changes. Returns up to 15 recent matches.
Get the full content of a specific changelog post from either Developer or Platform changelog. Provide the full URL.
Get updates from specific platform categories like POS, Admin, Checkout, Payments, etc. Optionally filter by recent days.
Get recent updates from the Platform Changelog. Specify days to look back (1, 3, 7, 14, or 30).
Search the Shopify Platform Changelog for product updates, new features, and merchant-facing changes. Returns up to 15 recent matches.
Output schemas not documented. LLMs cannot plan downstream operations or extract required fields (e.g., post URLs, dates, categories). Baseline: 100% of A+ tools document return types.
Parameter constraints (days: 1,3,7,14,30; limit: 1-30) documented in descriptions but not enforced as JSON Schema enums. LLMs cannot validate before calling; invalid values reach the tool.
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). All 8 tools are READ_ONLY but this is not declared in schema. Agents cannot distinguish safe tools from destructive ones.
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 46 | <=2025-11-25 | v2 |
Search across both Developer and Platform changelogs simultaneously. Returns combined results sorted by date.
Pagination not explicit. Tools return 'up to 15' or 'up to 30' results but no cursor, offset, or next_page_token in schema. Large result sets risk context window exhaustion.
Error handling not visible in code. No recovery guidance (e.g., 'URL not found, try search_all() first'). Agents cannot self-correct on failures.