Provenance-first tools for research data agents. AI-agent assisted toolkit for auditable academic data collection workflows.
Academic Data Hunter has 4 tools with schemas and basic descriptions, but suffers from critical naming and description gaps. Tool names lack action verbs (run_round, validate_round, benchmark_eval are vague). Parameter descriptions are trivial (e.g., 'data', 'value col') with no guidance on format, constraints, or dependencies. No output schemas documented. Error handling is minimal. The server is STDIO-only, which caps protocol readiness at 50 regardless of definition quality.
Score a research-data run on coverage and provenance quality.
Export an evidence-backed delivery bundle for a research-agent run.
Generate the next missing-data task file for a research dataset.
Run QC and source-registry consistency validation for a research dataset.
Tool names lack action verbs. 'run_round', 'validate_round', 'benchmark_eval' do not clearly convey what action occurs. Should be 'generate_task_file', 'validate_dataset', 'score_research_run'.
Parameter descriptions are trivial placeholders (e.g., 'data', 'value col', 'key'). No guidance on format, constraints, valid ranges, or dependencies. LLMs cannot infer meaning from these.
No output schemas documented. Tool descriptions do not specify what fields are returned or their types. Agents cannot plan downstream calls or extract required data.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 41 | 2025-06-18+ | v2 |
Parameter naming is inconsistent and ambiguous. 'data' could be a file path, dataset ID, or raw content. 'key' appears in multiple tools with no explanation. Use suffixes like 'data_path', 'dataset_id', 'registry_key' for clarity.
No error handling guidance. Tool descriptions do not explain failure modes, recovery steps, or when to retry. Error responses will not guide LLM recovery.