Webpipe has 23 tools with visible schemas and descriptions, but quality is inconsistent. Core tools (search_evidence, web_fetch, web_extract) have detailed parameter schemas with 10-20 params each, but descriptions are terse (50-100 chars) and lack actionable guidance. 6 deprecated tools (web_search, arxiv_search, http_fetch, etc.) clutter the surface. Parameter descriptions are generic ('Search query string', 'URL to fetch') without format constraints, ranges, or examples of valid values. No output schemas documented. Error handling is absent, no guidance on retryability, user-fixable errors, or recovery paths. Tool naming is reasonable (verb_noun pattern) but composition is poor: search_evidence, web_fetch, web_extract, and web_seed_search_extract overlap significantly, forcing LLMs to reason about which to use. No tool annotations (readOnlyHint/destructiveHint) despite clear risk levels. Baseline: 549 production tools average 194 chars for descriptions; webpipe averages ~70 chars.
Search and retrieve papers from ArXiv
Deprecated: use arxiv instead
Deprecated: use arxiv instead
Deprecated: use web_fetch instead
Deprecated: use web_extract instead
Deprecated: use web_extract instead
Search for academic papers
6 deprecated tools (web_search, arxiv_search, arxiv_enrich, web_search_extract, http_fetch, page_extract, page_extract_text) clutter the tool surface. LLMs must reason about which canonical tool to use, wasting tokens and increasing error likelihood.
Parameter descriptions are generic and lack actionable constraints. E.g., 'Search query string' does not specify length limits, character restrictions, or format. 'Maximum bytes to read' lacks a default or recommended range. LLMs cannot infer valid input bounds.
No output schemas documented. Tools return structured content but LLMs cannot plan downstream calls or extract fields without seeing the response shape. E.g., does search_evidence return 'urls', 'results', 'matches'? Does arxiv return 'papers' or 'entries'?
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 42 | 2025-06-18+ | v2 |
Ingest a repository for search and extraction
Search and extract evidence from URLs or web search results
Search and extract from local cache
Perform deep research on a topic
Explore and extract from a website
Extract structured content from a URL
Fetch a URL and return its content
Search using Perplexity API
Deprecated: use search_evidence instead
Deprecated: use search_evidence instead
Search, seed, and extract from web results
Generate seed URLs for web exploration
Extract content from a website using its sitemap
Metadata and usage statistics for webpipe
Get usage statistics for webpipe (accessible via webpipe_meta?method=usage)
Reset usage statistics (accessible via webpipe_meta?method=usage_reset)
No error handling guidance. Tools lack descriptions of failure modes, retryability, or recovery paths. E.g., if web_fetch times out, should the agent retry? If a URL is invalid, what should it do? No actionable error messages.
Tool annotations missing. search_evidence and web_fetch are READ_ONLY; repo_ingest and webpipe_usage_reset are WRITE. No readOnlyHint or destructiveHint in schemas. LLMs cannot distinguish safe from risky tools without explicit annotations.