MCP server for interacting with the Datadog API
Three tools with basic schemas and descriptions, but significant gaps in parameter documentation and output schema clarity. example_tool and search_logs have reasonable descriptions (50-100 chars), but get_commits lacks context on when to use it. All tools have input schemas with type info, but parameter descriptions are minimal or missing for optional fields. No output schemas documented. No error handling guidance. Tool names follow verb_noun pattern (good), but descriptions don't explain prerequisites, return structure, or when to prefer one tool over similar alternatives.
An example tool that processes a message
Fetches the most recent commits from a GitHub repository
Search logs in Datadog using various filters and parameters
Output schemas not documented. LLMs cannot plan downstream tool calls or extract required fields without knowing what search_logs, get_commits, or example_tool return.
get_commits description is vague ('Fetches the most recent commits'). Does not explain when to use it vs other tools, what fields are returned, or whether it requires authentication.
Optional parameters in search_logs (start_time, end_time, sort_by, page_cursor, filters) lack descriptions explaining their purpose, format, or constraints. LLMs cannot infer when to use them.
No error handling guidance. Tools do not document what errors are retryable, what user-fixable errors look like, or how to recover from failures.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 47 | 2026-07-28+ | v2 |
search_logs accepts a 'filters' object with string values but does not document the expected structure, valid keys, or examples. LLMs will guess at the format.