Photosensitivity hazard detector for video content using luminance analysis and AI adjudication
Flashframe exposes 4 ClickHouse/chDB query tools with minimal documentation. Tool names lack clear action verbs (run_query, run_chdb_select_query are vague). Descriptions are present but generic (10-50 chars, below the 50-200 char LLM-optimized baseline). Input schemas visible but sparse: run_query and run_chdb_select_query accept only a 'query' string with no validation, enums, or constraints. list_databases has empty input {}. list_tables accepts 'database' string but no format guidance. No output schemas documented. No error handling guidance. No parameter descriptions beyond the query string itself. Tools appear to be proof-of-concept spikes (files in spikes/ directory) rather than production-grade definitions.
List all databases in ClickHouse
List all tables in a ClickHouse database
Execute a chDB SELECT query on local CSV files
Execute a ClickHouse SQL query
Tool names lack action verbs. 'run_query' and 'run_chdb_select_query' are vague, they do not clearly distinguish intent (execute vs. fetch vs. analyze). Should be 'execute_clickhouse_query' and 'execute_chdb_select_query' or similar.
Descriptions are too short (10-50 chars, below 50-char minimum). 'Execute a ClickHouse SQL query' lacks context on when to use run_query vs. run_chdb_select_query, what the output format is, or error recovery steps.
No output schemas documented. LLMs cannot infer what fields to expect from query results, pagination structure, or error format. Breaks downstream tool chaining.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 37 | 2025-06-18+ | v2 |
Input schemas lack validation constraints. 'query' parameter accepts any string with no length limits, SQL injection guards, or format hints. No enums, patterns, or examples.
No error handling guidance. Tools do not document what errors are retryable, what user-fixable errors look like, or how to recover from SQL syntax errors or connection failures.