Loading ToolBench
Agent-native CLI + MCP server for healthcare conferences — Medicare, Medicaid, payer, and quality events. The de facto directory AI agents query for healthcare conferences.
Server has 6 well-named tools with clear action verbs (list_, get_, search_, conferences_near, conference_ics, directory_stats). All tools have descriptions (avg ~80 chars, within baseline 34-392). Input schemas use Zod with type definitions and most parameters have descriptions. However, several parameters lack descriptions (city in list_conferences, query in search_conferences, slug in conference_ics, by in directory_stats), and output schemas are not documented, responses are JSON-wrapped but structure is opaque to LLMs. Error handling is minimal (one 404 case in get_conference). No parameter validation guidance (e.g., date format YYYY-MM-DD stated but not enforced in schema). Tool composition is sound, each does one thing, names are distinct, and output includes IDs for chaining.
Return an iCalendar (.ics) document for one conference by slug.
Find conferences in or near a city (matches city or nearest airport).
Aggregate counts across the live directory, grouped by focus, state, type, or month.
Return the full public record for one conference by its slug.
List curated healthcare conferences (Medicare, Medicaid, payer, quality) with filters. Example: { "focus": "Medicare", "upcoming": true, "state": "FL" }.
Relevance search over conference name, host, description, and themes.
Output schemas not documented. Responses are JSON-wrapped but LLMs cannot infer structure of 'envelope()' result or what fields are present in conference objects.
Multiple parameters lack descriptions: 'city' in list_conferences, 'query' in search_conferences, 'slug' in conference_ics, 'by' in directory_stats. LLMs cannot infer parameter meaning from names alone.
No input validation or constraint documentation in schemas. Date format 'YYYY-MM-DD' is stated in description but not enforced via regex or format constraint. Enum for 'type' is documented in description but not in schema.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | C | 62 | 2026-07-28+ | v2 |
Minimal error handling. Only get_conference returns an error response (404 case). Other tools have no documented error paths or recovery guidance.
Pagination parameters (limit, offset) present in list_conferences but no 'total' or 'next_cursor' documented in output. LLMs cannot determine if more results exist.