A server that provides tools for web search and information extraction from search results
Two tools with basic schemas and minimal descriptions. search-web has a 54-char description (below baseline 194 chars); extract-info-from-search has 60 chars. Both schemas present but lack output documentation. No error handling guidance, no parameter constraints (e.g., page_number bounds), no idempotency hints. Tool names are verb-based (search-, extract-) but descriptions are vague about what data is returned or when to use each tool. No indication of whether tools modify state or are read-only (though marked READ_ONLY in metadata). Missing parameter descriptions for page_number (what range? what happens if out of bounds?). No guidance on pagination limits or result structure.
Extract relative information from previous searches
Perform a web search and scrape results
Descriptions are too short (54 and 60 chars vs. baseline 194 chars). Lack context on WHEN to use each tool, WHAT data is returned, and HOW they differ. LLMs cannot reliably select between them.
No output schema documented. Callers do not know what fields to expect from search results or extracted info. Downstream tool chaining is impossible without trial-and-error.
page_number parameter lacks description, bounds, and error guidance. What is the valid range? What happens if page_number exceeds available results? Does it default to 1 or error?
No error handling or recovery guidance. If a search fails or returns no results, the LLM has no actionable next step. No distinction between retryable and fatal errors.
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 46 | <=2025-11-25 | v2 |
Tool composition unclear. extract-info-from-search claims to 'merge' queries from 'previous searches' but does not document dependency on search-web or how state is tracked between calls. Stateless vs. stateful behavior is ambiguous.