Loading ToolBench
MCP server for Firebird database connectivity via ODBC, providing tools for schema introspection, data querying, and routine execution
14 tools with basic schemas and descriptions, but significant gaps in parameter documentation and output schema clarity. Most tools have 1-4 parameters with type info, but descriptions are minimal (10-50 chars). No tool annotations (readOnlyHint/destructiveHint). Error handling and recovery guidance absent. Naming is verb-prefixed (firebird_get_*, firebird_execute_*) but generic descriptions like 'Retrieves...' lack context on when to use each tool vs. alternatives. Output schemas not documented, LLMs cannot plan downstream calls. No pagination support despite tools like firebird_execute_reader that could return large result sets.
Inserts a new row into a table in the Firebird database
Configuration tool for the server
Counts the number of rows in a table in the Firebird database
Executes one or more SQL-92 statements with supported operations against the Firebird database
Executes one or more SQL-92 SELECT statements against the Firebird database
Executes a stored procedure or function in the Firebird database
Retrieves column information for a table in the Firebird database
Retrieves foreign key information for a table in the Firebird database
Output schemas not documented. Tools like firebird_execute_reader and firebird_get_columns return DataTable results, but LLMs cannot see field names, types, or structure. This prevents planning downstream tool calls and forces agents to guess at response format.
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). firebird_execute_nonquery, firebird_execute_routine, and firebird_add_row are destructive but unmarked. Agents cannot distinguish safe reads from writes without explicit hints.
Parameter descriptions are minimal (10-50 chars) and lack context. 'Name of the schema' and 'Name of the table' do not explain when to use firebird_get_tables vs firebird_get_columns, or whether schema is required for Firebird (which may not use schemas). Descriptions should guide tool selection.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 43 | 2026-07-28+ | v2 |
Retrieves index information for a table in the Firebird database
Retrieves primary key information for a table in the Firebird database
Retrieves stored procedures and functions from the Firebird database
Retrieves list of tables from the Firebird database
Provides instructions for using the Firebird MCP server
Retrieves the Firebird server version
No pagination support. firebird_execute_reader accepts arbitrary SQL and could return thousands of rows, but no limit or offset parameters. Large result sets will exhaust context windows and degrade LLM reasoning.
No error recovery guidance. Tools lack descriptions of failure modes, retryability, or next steps. If firebird_execute_reader fails with a SQL syntax error, the LLM has no guidance on how to self-correct or what to try next.