An MCP server for DataRobot that provides tools for predictive analytics, model management, deployment, and batch predictions
Critical failures across all dimensions. Tool definitions exist only as names in a fixture file (smoke_list_tools.py) with no visible schema, parameter, or output documentation in the provided source. The single example tool (user_tool_example) has a minimal schema with one parameter but lacks comprehensive documentation. No error handling guidance, no output schemas, no parameter descriptions beyond names. Descriptions are generic placeholders (e.g., 'Analyze a dataset in the catalog'). This is a template/fixture server with incomplete tool definitions, tool implementations are not visible in the provided code.
Analyze a dataset in the catalog
Browse a datastore in the catalog
Check if a dataset is eligible for time series modeling
Get exploratory data analysis insights for a dataset
Get a preview of a dataset or datastore
List datasets in the catalog
No input schemas visible for 34 of 35 tools. Tool definitions exist only as names in fixture file with zero parameter documentation, type information, or constraints.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 41 | 2025-06-18+ | v2 |
List datastores in the catalog
Query a datastore in the catalog
Suggest machine learning problems for a dataset
Upload a dataset to the catalog
Create a deployment from a model
Generate a sample prediction from a deployment
Get features for a deployment
Get information about a deployment
Get a list of deployments
Get model information for a deployment
Get prediction history for a deployment
Validate prediction data for a deployment
Get feature impact for a model
Get lift chart for a model
Get ROC curve for a model
Get detailed information about a model
Get dataset information for a project
List models in a project
List modeling projects
Score a dataset using a model
Start AutoPilot for a project
Get the best model from a project
Generate batch predictions from a dataset
Generate batch predictions from a partition
Get status of a batch prediction job
Get results from a batch prediction job
Score data in real-time using a catalog deployment
Score data in real-time with inline data
A user tool example description.
Descriptions are generic placeholders (10-50 chars) lacking context for LLM tool selection. No explanation of WHEN to use each tool, prerequisites, or return value structure.
No output schemas documented. LLMs cannot infer what fields to expect or plan downstream tool calls. No guidance on pagination, result limits, or field structure.
No error handling guidance. Tools provide no recovery hints, error classification, or actionable messages for LLM retry logic.
Tool definitions inferred from fixture file only; actual implementation code not provided. Cannot verify parameter validation, error handling, or output structure.