Harvard Dataverse — research dataset repository (~150k datasets)
Harvard Dataverse MCP has basic tool definitions with schemas and descriptions, but falls short of production quality. All 4 tools have input schemas and descriptions, but descriptions are minimal (10-80 chars, well below the 194-char baseline). Parameter descriptions are sparse or missing entirely. No output schemas documented. Error handling is minimal. Tools lack the LLM-optimized descriptions and comprehensive parameter guidance needed for reliable agent selection and execution. The server reads from a public API with no state mutation, which is appropriate, but the interface design does not follow agentic tool patterns for clarity and composability.
Dataset metadata by DOI persistent id (e.g. "doi:10.7910/DVN/...").
List files in a dataset.
Dataverse (collection) metadata by alias or id.
Search datasets / files / dataverses.
Parameter descriptions missing or trivial. 'type' in search tool lacks description; 'sort', 'per_page', 'start' have minimal guidance. LLMs cannot infer when to use 'name' vs 'date' sort or what per_page range is safe.
Tool descriptions are too short (10-80 chars vs 194-char baseline). 'Dataset metadata by DOI persistent id' lacks context on when to call this vs search(). No guidance on expected output structure or prerequisites.
No output schemas documented. LLMs cannot plan downstream calls or extract required fields. Responses from dvGet() are raw API JSON with no filtering or field documentation.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 47 | 2026-07-28+ | v2 |
Error handling is minimal. dvGet() throws generic errors ('Dataverse: not found', 'Dataverse: 404 ...') with no recovery guidance. LLMs cannot self-correct or know whether to retry, ask user, or try alternative tools.
Parameter 'persistent_id' in dataset and dataset_files tools lacks format guidance. Example 'doi:10.7910/DVN/...' is in description but not enforced. LLMs may pass invalid formats without validation feedback.