MCP server for searching arXiv papers related to topics
Single tool with basic structure but significant gaps. Tool name 'search_arxiv' follows verb_noun convention (+). Input schema present with types and defaults (+). However, description lacks actionable detail for LLM selection, parameter descriptions are minimal, output schema is undocumented, and no error handling guidance. Tool description (89 chars) is below the 194-char baseline for production tools. No pagination support despite API returning lists. Missing error recovery patterns.
Search for arXiv papers related to a topic. Parameters: topic (str): The topic or keywords to search for. max_results (int): Number of results to retrieve. Returns: List of dictionaries with paper details (title, authors, summary, link).
Output schema undocumented. Tool returns list of dicts with title, authors, summary, link but LLM has no formal schema to plan downstream operations or validate structure.
Tool description too brief (89 chars, baseline 194). Lacks WHEN to use, prerequisites, and distinguishing context. Does not explain when to call search_arxiv vs other discovery tools.
No pagination support. API accepts max_results but tool does not expose offset/start or return total_count. Large result sets will blow context window; no guidance on limits.
Error handling returns generic Exception('Failed to fetch results from arXiv API.'). Does not tell LLM what to do next, whether to retry, or what caused the failure.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 45 | 2026-07-28+ | v2 |
Parameter 'topic' description is minimal ('The topic or keywords to search for'). Does not specify format constraints, length limits, or examples of valid queries.