A data catalog and metadata management platform with Model Context Protocol (MCP) server support. Marmot provides data discovery, lineage tracking, and integration with multiple data sources and cloud platforms.
Scoring was not performed
No input parameter schemas visible in source code. Cannot verify parameter types, required fields, enums, or constraints. Per hard scoring rule: schema score for all tools must be 0 when schemas are not visible.
Tool descriptions are verbose (400+ chars) and contain embedded instructions/examples rather than concise LLM-optimized summaries. These descriptions bury the core purpose in procedural text.
Descriptions include sample values and literal examples (e.g., 'types: ["topic", "table", "bucket"]', 'query: "customer"'). Per pattern: examples encourage LLMs to reuse values literally. Use enums and formal constraints instead.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-22 | F | 44 | 2026-07-28+ | v2 |
| 2026-03-09 | F | 28 | - | v1 |
No output schema documented. LLMs need to know what fields to expect (e.g., what discover_data returns). Without documented output structure, agents cannot plan downstream calls.
No error handling guidance visible. Tools lack recovery hints like 'If no results found, try broadening the search' or error classification (retryable vs user-fixable vs fatal).
Parameter documentation mixed into tool description rather than formally defined in schema. 'discover_data' instructions describe parameter semantics (e.g., 'Default limit is 20 results, max is 100') but this should be in parameter-level schemas with min/max constraints.