Loading ToolBench
High-value biotech regulatory calendar events (keyless). Provides FDA advisory committee meetings and PDUFA catalyst disclosures from Federal Register and SEC EDGAR APIs.
Two tools with complete input schemas and strong domain-specific descriptions (194 - 250 chars each). Both tools clearly state their purpose, use cases, and return structure. However, critical gaps: (1) NO output schema documentation, LLMs cannot predict response structure for downstream chaining; (2) parameter descriptions lack format constraints (e.g., 'limit' accepts number|string but no validation guidance); (3) no error handling guidance, tools return {error, retry_hint} but no categorization of retryable vs fatal failures; (4) no tool annotations (readOnlyHint, idempotentHint) despite both being read-only, keyless, and idempotent. Naming is domain-appropriate (fda_adcom_calendar, pdufa_catalysts) but lacks action verbs (list_, search_). Parameter defaults are sensible (upcoming_only=true, limit=10/8) and reduce required args.
Upcoming FDA advisory committee (AdCom) meeting calendar — a leading biotech regulatory catalyst. Lists FDA panel meetings announced in the Federal Register (keyless), extracting the scheduled meeting date from each notice. Covers oncology (ODAC), cellular/tissue & gene therapy (CTGTAC), and every other FDA advisory committee; captures panel-vote meetings that precede or accompany drug/biologic approval decisions (PDUFA-adjacent). Returns each meeting with committee, meeting date (ISO when parseable) plus raw date text, topic, publication date, Federal Register URL, and document number, sorted soonest-first. Use for AdCom, advisory committee, panel vote, drug approval catalyst, FDA meeting calendar, upcoming biotech panels.
Companies with disclosed PDUFA dates — the highest-signal binary biotech catalyst. Searches recent SEC EDGAR 8-K filings (keyless) for PDUFA target / goal / action dates and extracts the date and surrounding context. A PDUFA date is the FDA decision date for an NDA or BLA; it is a scheduled binary event that moves biotech stocks. Returns each disclosure with company, ticker, CIK, filing date, form, PDUFA date (ISO when parseable), a short context snippet, the SEC filing URL, and accession number. Use for PDUFA date, PDUFA goal date, FDA decision date, upcoming FDA decisions, drug approval catalyst, NDA/BLA decision date, biotech binary event, catalyst by ticker.
No output schema documented. LLMs cannot predict response structure (fields, types, nesting) for downstream tool chaining or data extraction. Code shows rows with meeting_date, committee, topic, etc., but this is invisible to the agent.
Parameter type ambiguity: 'limit' and 'upcoming_only' accept type: ['number', 'string'] without validation rules. LLMs may pass '999' or 'true' as strings; no guidance on parsing or coercion.
No tool annotations. Both tools are read-only and idempotent (keyless, no side effects), but lack readOnlyHint and idempotentHint. Agents cannot infer safety properties.
Tool names lack action verbs. 'fda_adcom_calendar' and 'pdufa_catalysts' are domain-specific but do not start with get_, list_, or search_. LLMs infer intent from verb; missing verbs reduce clarity.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 54 | 2026-07-28+ | v2 |
Error handling lacks categorization. Tools return {error, retry_hint} but do not classify errors as retryable, user-fixable, or fatal. Agents cannot decide whether to retry, ask user, or abort.