Loading ToolBench
MCP server for driving Adobe Premiere Pro, with tools that verify their own writes
41 tools with inconsistent quality. Most have basic descriptions (10-50 chars) and minimal parameter documentation. Schemas present but sparse, many parameters lack type info or constraints. No enums for constrained inputs (e.g., track_type, edge, mode). Error handling absent; no recovery guidance. Tool names follow verb_noun pattern (good), but descriptions are too terse to guide LLM selection. No output schemas documented. High-risk tools (run_script, remove_clip, delete_marker) lack confirmation patterns or destructive warnings.
Add a marker at a specific time
Add a media item to the timeline
Add a transition to a clip
Analyze a frame at a specific time
Apply an effect to a clip
Check the current edit for issues
Check media files for issues
Create a new bin in the project
Descriptions uniformly terse (10-35 chars). LLMs cannot distinguish when to call set_scale vs set_clip_speed vs set_lumetri. Descriptions must explain WHAT, WHEN, and WHAT IT RETURNS (50-200 chars baseline).
No enums for constrained inputs. track_type accepts 'audio' or 'video' but is free-form string. edge accepts 'start' or 'end' but no enum. mode accepts 'overwrite' or 'insert' but no enum. LLMs hallucinate invalid values.
Destructive/irreversible tools (run_script, remove_clip, delete_marker) lack confirmation patterns, dry-run options, or explicit warnings in descriptions. Agents can accidentally delete content without safeguards.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 50 | 2026-07-28+ | v2 |
Create a new sequence from media items
Delete a marker at a specific time
Export a frame to a file
Get details about a specific clip
Get color grading information
Get the current playhead position
Get the in/out range of the current sequence
Get the status of the Warp Stabilizer effect
Get the current timeline/sequence structure
Apply color grading to multiple clips
List available effects
List available export presets
List all markers in the sequence
List items in the project
List all sequences in the project
List available transitions
Match color grade from source to target clips
Move a clip to a new position
Test connection to Premiere Pro
Remove a clip from the timeline
Run a custom ExtendScript script
Set audio level of a clip
Enable or disable a clip
Set the speed of a clip
Set fade in/out on a clip
Set Lumetri color correction parameters
Set the playhead position
Set the scale of a clip
Set the in/out range of the current sequence
Set the mode of the Warp Stabilizer effect
Set track state (mute/unmute)
Split a clip at a specific time
Trim a clip
No output schemas documented. LLMs cannot plan downstream calls or extract required fields. E.g., get_clip returns unknown structure; add_marker returns unknown; list_project_items returns unknown. Agents must guess field names.
Error handling absent. runTool() catches errors and returns isError=true with message, but no recovery guidance, categorization (retryable vs fatal), or actionable next steps. LLMs cannot self-correct.