Loading ToolBench
A voice-based USDA agricultural assistance chatbot that helps farmers find grants, programs, service centers, and fill forms. Provides access to USDA programs, news, NASS agricultural data, and form filling capabilities.
8 tools with reasonable naming (verb_noun pattern) and documented schemas. However, descriptions are inconsistent in depth and quality. Most parameter descriptions are present but generic. Output schemas are not explicitly documented. Error handling guidance is minimal. Tool composition is sound (each does one thing), but parameter constraints could be tighter. No tool annotations (readOnlyHint, destructiveHint) despite all being read-only operations.
Get the list of fields for a specific form so the AI knows what to ask for. Also opens the form panel in the UI.
Get full details for a specific USDA program.
List all forms available for filling.
Get the number of rows that would be returned by a Quick Stats query. QuickStats API uses WHAT/WHERE/WHEN parameters: WHAT (commodity_desc, sector_desc, statisticcat_desc, etc.), WHERE (state_alpha, county_name, region_desc, etc.), WHEN (year, year__GE, freq_desc, etc.).
Get all possible values for a Quick Stats parameter. Example: param='sector_desc' or param='commodity_desc'. The QuickStats API returns values as: {"param_name": ["VAL1", "VAL2", ...]}
Search all USDA programs (FSA, RD, and active deadlines) with a single query.
Output schemas not documented. Tools return data but LLMs cannot plan downstream calls without knowing response structure (e.g., what fields does search_state_news return? Is there pagination?)
No tool annotations despite all 8 tools being read-only. Missing readOnlyHint metadata prevents agents from understanding safety profile and retry semantics.
Parameter constraints underspecified. nass_get_counts accepts 'filters' as free-form object with no enum/pattern validation. search_state_news 'limit' has no min/max bounds. LLMs may pass invalid values.
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 52 | <=2025-11-25 | v2 |
Search for USDA service center contacts (FSA, NRCS, Rural Development) by county. Returns staff emails, phone numbers, physical and mailing addresses. Use when user asks about local USDA offices or service centers.
Search USDA state news for recent announcements, deadlines, programs, and success stories. Good for questions about current events, program updates, conservation news, and state-specific USDA activities.
Error handling guidance absent. No recovery hints (e.g., 'If form not found, call list_available_forms first'). Agents cannot self-correct on failures.
Pagination not documented. search_state_news and search_all_programs accept 'limit' but no offset/cursor. Large result sets may exceed context window without pagination guidance.