Loading ToolBench
A gateway server that provides MCP tools for workspace management, repository inspection, file operations, and verification/mutation workflows. Supports both browser operator and delegated dispatch adapters.
14 tools with significant definition gaps. Most tools lack input schemas (9 of 14 have no visible schema in source). Descriptions are present but generic (avg ~80 chars, below 194-char baseline). No parameter descriptions for most tools. No output schemas documented. Error handling and recovery guidance absent. Tool naming uses dot notation (workspace.open, file.read) rather than verb_noun convention, making intent less clear to LLMs. No tool annotations (readOnlyHint/destructiveHint) despite clear risk classifications in metadata.
Create a new file in the workspace
Read the contents of a file within an opened workspace, with size and content validation
Create a git commit with the specified message
Get the result of a completed git commit operation
Check the health status of the gateway and executor, verifying DevSpace tool compatibility and protocol version
Preview a proposed file mutation without applying it
9 of 14 tools have no visible input schema in source code. Cannot verify parameter types, constraints, or descriptions.
Tool naming uses dot notation (workspace.open, repo.list) instead of verb_noun convention (open_workspace, list_repo). LLMs parse intent from names, dot notation obscures action verbs and makes tool selection harder.
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields. Violates pattern:tool and mxe:response-field-naming.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 45 | 2026-07-28+ | v2 |
Get the result of a completed mutation operation
Get the diff of changes in the repository with optional path filtering
List files and directories in the repository with optional path filtering
Search for text patterns in the repository with configurable case sensitivity and result limits
Get a snapshot of the repository state including branch, commit, and file status information
Preview a verification operation without executing it
Execute a verification profile command within a workspace and return the exit code and output
Open a workspace at the specified path, validating against allowed roots and returning a workspace ID
No tool annotations (readOnlyHint, destructiveHint, idempotentHint) despite clear risk classifications (READ_ONLY vs WRITE). Agents cannot distinguish safe from destructive operations without explicit hints.
Descriptions for mutation.preview, mutation.result, verify.preview, git.commit, git.commit.result are under 20 characters (mostly 30 chars or less). Insufficient for LLM tool selection.