Loading ToolBench
A web service that converts OpenAPI specifications to MCP Server configurations. Wraps a Go command-line tool (openapi-to-mcp) and provides a RESTful API with a web UI for file upload, conversion, and download.
Three tools with basic schemas and descriptions, but significant gaps in parameter documentation and error handling. The 'convert' tool has a well-structured input schema with 5 parameters, each with type and description. However, output schema is not documented, the tool returns file content as a string without specifying structure. The 'download' tool has minimal schema (single string param) and generic description. The 'health' tool lacks meaningful documentation. No tool includes error recovery guidance, actionable error messages, or idempotency hints. Descriptions are present but brief (34-72 chars), below the 50-200 char LLM-optimized baseline. No tool annotations (readOnlyHint, destructiveHint) despite all being read-only operations.
Converts OpenAPI specification to MCP Server configuration. Accepts an OpenAPI file (JSON or YAML), processes it through the openapi-to-mcp Go tool, and returns the generated MCP configuration.
Downloads a previously generated MCP configuration file by filename.
Health check endpoint that verifies the service is running and the openapi-to-mcp Go tool is available.
Output schemas not documented. 'convert' returns file content as string without specifying structure (YAML/JSON object fields). LLMs cannot plan downstream operations or extract specific fields.
No error handling guidance. Tool descriptions lack recovery hints (e.g., 'If validation fails, check OpenAPI spec syntax'). Errors from Go subprocess are not caught or translated into actionable messages for LLMs.
Missing tool annotations. All three tools are read-only but lack readOnlyHint annotation. This prevents agents from reasoning about safety and retry logic.
Parameter descriptions too brief. 'download' filename param has no format guidance (e.g., 'mcp-config-*.yaml or mcp-config-*.json'). 'health' has empty input schema with no explanation of what it checks.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 43 | 2026-07-28+ | v2 |
No pagination or result limits documented. 'convert' returns entire file content as string; if OpenAPI spec is large, response could exceed context window. No guidance on max file size handling.