Loading ToolBench
MCP server (stdio) routing tool calls to the live Unity Open MCP Bridge or batch Unity processes.
Critical gaps across all dimensions. Tool descriptions are present but generic (avg ~80 chars, well below 194-char baseline). Input schemas visible for most tools but severely underdeveloped: parameters lack type definitions (e.g., 'mutation' and 'baseline' are bare objects with no internal schema), descriptions are minimal or absent for many parameters. Output schemas are completely undocumented, no tool declares what it returns. Error handling is absent; no recovery guidance. Naming is inconsistent: 'unity_open_mcp_*' prefix on meta-tools violates verb-first convention; 'gate', 'checkpoint', 'delta' lack clarity on what they operate on. No evidence of idempotency, pagination, or composition patterns. Security: no audit logging visible, no permission gates, no rate limiting.
Gate-and-verify tool that applies fixes to detected issues. Part of the verify surface.
Gate-and-verify tool that creates a baseline for regression testing. Part of the verify surface.
Build-settings tool that sets the build target. Build pipeline + ProjectSettings reads and mutators.
Build-settings tool that starts a build. Build pipeline + ProjectSettings reads and mutators.
Gate-and-verify tool that creates checkpoints for state comparison. Part of the verify surface.
Core tool that checks the current compilation status of the Unity project. Part of the essential editor entry points.
Gate-and-verify tool that computes deltas between checkpoints. Part of the verify surface.
Output schemas completely undocumented. No tool declares what it returns, forcing LLMs to guess structure and preventing downstream tool chaining.
Parameter schemas use bare object types ('mutation', 'baseline') with no internal field definitions. LLMs cannot validate or construct these objects.
Meta-tool naming violates verb-first convention ('unity_open_mcp_capabilities', 'unity_open_mcp_manage_tools'). Should be 'list_capabilities', 'activate_tool_group', etc.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 43 | 2026-07-28+ | v2 |
Gate-and-verify tool that analyzes asset and object dependencies. Part of the verify surface.
Core tool that reports the current Unity Editor status and state. Part of the essential editor entry points.
Core tool that executes C# code in the Unity Editor context. Part of the essential editor entry points.
Core tool that executes Unity Editor menu items. Part of the essential editor entry points.
Core tool that finds members (fields, properties, methods) in Unity types. Part of the essential editor entry points.
Gate-and-verify tool that finds references to assets and objects. Part of the verify surface.
Gate-and-verify tool that validates mutations and applies gates. Part of the verify surface.
Gate-intelligence tool that estimates gate budget for mutations. Pre/post-mutation intelligence.
Gate-intelligence tool that previews the impact of mutations. Pre/post-mutation intelligence.
Core tool that invokes methods on Unity objects. Part of the essential editor entry points.
Asset-intelligence tool that lists assets. Offline asset reads and reference intelligence.
Gate-intelligence tool that explains mutations. Pre/post-mutation intelligence (read-only compositions).
Core meta-tool that pings the bridge to verify connectivity and reports bridge status.
Asset-intelligence tool that reads asset data. Offline asset reads and reference intelligence.
Gate-and-verify tool that checks for regressions against a baseline. Part of the verify surface.
Asset-intelligence tool that reserialized assets. Offline asset reads and reference intelligence.
Gate-and-verify tool that performs a comprehensive scan of the entire project. Part of the verify surface.
Gate-and-verify tool that scans specific paths for assets and objects. Part of the verify surface.
Asset-intelligence tool that searches for assets. Offline asset reads and reference intelligence.
Build-settings tool that sets player settings. Build pipeline + ProjectSettings reads and mutators.
Meta-tool that reports the compiled tool inventory, tool groups, and session activation state. Returns the full capabilities surface including available tools, their descriptions, and group membership.
Meta-tool for session-scoped tool group activation. Supports list_groups (enumerate all groups), suggest (recommend groups based on project state), and activate_for (enable specific groups for the session).
No error handling guidance. Tools like 'execute_csharp' and 'invoke_method' can fail in many ways (compilation error, method not found, permission denied) but provide no recovery hints.
Destructive tools (execute_csharp, apply_fix, build_start, reserialize) lack confirmation/dry-run patterns. No protection against accidental mutations.