Local bug-reproduction video analysis exposed over MCP (VS Code and any MCP client)
Framesleuth has 8 tools with complete input schemas and descriptions, but quality is uneven. Tool names follow verb_noun convention (analyze_video, get_report, list_reports). Descriptions range from 80 - 180 chars, meeting the 10 - 1024 baseline. However, parameter descriptions are sparse or missing context. Output schemas are not documented, LLMs cannot predict what fields to expect from responses. Error handling is absent from descriptions. The analyze_video tool lacks guidance on prerequisites (repo_root requirement). No tool annotations (readOnlyHint/destructiveHint) despite clear risk classifications in metadata.
Analyze a video file and generate a structured bug report bundle with classification, evidence extraction, and code candidate identification.
Retrieve a keyframe image from a report with path traversal protection.
Retrieve a parsed report bundle for a job, optionally filtered to a slim view of action-relevant fields.
Generate or retrieve a cached GIF preview of a video report.
List available action modes that shape the fix-prompt's task block.
List all available report IDs in the bundle directory.
Render HTML to a video file (MP4 or GIF) using headless Chromium.
Output schemas not documented. LLMs cannot predict response structure (fields, types, pagination). Responses like get_report and list_reports lack documented return types, forcing LLMs to guess what data is available.
Missing tool annotations. Tools marked WRITE (analyze_video, get_video_gif, render_html_video) lack destructiveHint/idempotentHint annotations. READ_ONLY tools lack readOnlyHint. Agents cannot distinguish safe from risky calls without explicit hints.
Parameter descriptions lack context. 'relative_file' in get_keyframe says 'Relative path to the keyframe file' but does not explain format, constraints, or examples. 'max_frames' in get_video_gif lacks min/max bounds. LLMs cannot validate inputs without explicit constraints.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | C | 69 | 2026-07-28+ | v2 |
Suggest sensible next-step actions for a report based on its content and analysis quality.
No error handling guidance in descriptions. Tools do not document failure modes, recovery steps, or what to do if a report is not found, a video fails to analyze, or rendering times out. Agents have no recovery path.
Tool descriptions do not explain when to use each tool or dependencies. analyze_video requires repo_root but does not explain why or what happens if omitted. No guidance on calling list_reports before get_report or list_actions before suggest_actions.