Semantic Scholar research workflows, standalone runtime, and MCP/HTTP interfaces.
16 tools with consistent verb-noun naming (search_, get_, paper_*, author_*). All tools have descriptions (avg ~80 chars, within baseline 34-392). Input schemas present with types and descriptions for all parameters. However, output schemas are NOT documented, critical gap for LLM planning. Error handling returns structured responses but lacks recovery guidance (e.g., 'try search_authors() first'). No tool annotations (readOnlyHint, destructiveHint). Parameter descriptions are adequate but lack format constraints (e.g., no enum for publication_types, no regex for IDs). Pagination support present (offset/limit) but no total_count or next_cursor documented in output. All tools are READ_ONLY, reducing risk, but composition chains are not optimized, e.g., paper_details returns paper_id but downstream tools don't clearly document what IDs they accept.
Get details for multiple authors in a single batch request
Get detailed information about a specific author by author ID
Get papers authored by a specific author with pagination support
Search for authors by query string with optional field filtering and pagination
Get paper recommendations based on multiple positive and negative seed papers
Get paper recommendations based on a single seed paper
Output schemas not documented. LLMs cannot plan downstream tool calls or extract required fields (e.g., paper_id, author_id) for chaining. Critical for multi-step research workflows.
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). All tools are READ_ONLY but this is not declared in schema, forcing LLMs to infer safety.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 59 | 2026-07-28+ | v2 |
Get authors of a specific paper with pagination support
Get autocomplete suggestions for paper titles
Get details for multiple papers in a single batch request
Bulk search for papers with pagination token support for large result sets
Get papers that cite a specific paper with pagination support
Get detailed information about a specific paper by paper ID
Get papers referenced by a specific paper with pagination support
Search for papers by relevance with advanced filtering options
Search for papers by exact title match with filtering options
Search for text snippets within papers matching a query
Parameter constraints missing. publication_types, fields_of_study, venue, sort, from_pool lack enum definitions. LLMs may hallucinate invalid values (e.g., 'sort: relevance_descending' instead of valid option).
Error responses lack recovery guidance. When author_details returns 404, response says 'Author not found' but does not suggest 'Try author_search() with a partial name.' Agents cannot self-correct.
Pagination not fully documented. Tools accept offset/limit but output schema does not specify total_count or next_cursor. LLMs cannot determine if more results exist or how to fetch them.