FlowMCP CLI exposes 15 tools with inconsistent quality. Most tools have descriptions (13/15), but descriptions are often vague or generic (e.g., 'Call a tool by name with JSON arguments'). Input schemas are present but minimal: most parameters lack type information beyond 'string' or 'boolean'. No output schemas are documented. Tool names use compound structures ('cache status', 'lists add-entry') rather than verb_noun convention, making intent ambiguous. Parameters like 'jsonArgs' and 'schemaPath' lack format constraints or validation guidance. Error handling is absent from visible definitions. No tool has documented return types or field mappings for chaining. The 'call' and 'private call' tools are particularly problematic: they accept arbitrary JSON strings, making it impossible for LLMs to validate inputs or understand expected outputs.
Clear the cache (optionally a single namespace).
Show cache namespaces, entry counts and sizes.
Call a tool by name with JSON arguments.
List all callable tools.
Generate the catalog from the configured schema folders.
Show the current configuration.
Set a configuration value.
Run diagnostics on the FlowMCP installation and configuration.
Inspect the shared lists and their entries.
Generic tool names lack action verbs. 'call', 'lists', 'cache' are nouns; 'doctor' is vague. LLMs cannot infer intent from names alone. Should be: 'invoke_tool', 'list_shared_lists', 'inspect_cache', 'run_diagnostics'.
Parameters 'jsonArgs' and 'schemaPath' lack format constraints, validation rules, or examples. LLMs cannot validate JSON syntax or file paths. Should specify: 'Valid JSON string (e.g., {"key": "value"})', 'Absolute or relative path to .mjs or .json schema file'.
No output schemas documented. Tools return results but LLMs cannot plan downstream calls or extract fields. E.g., 'call list-tools' returns what? Array of tool objects? Each with name, description, schema? Unknown.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 39 | 2026-07-28+ | v2 |
Append a JSON entry to a named shared list.
Resolve and show the references of an alias.
Ad-hoc call a path-addressed private schema (never registered; scan active).
Start an MCP server for a schema.
Generate a skill for a tool id.
Validate a FlowMCP schema.
Error handling absent. No guidance on recovery. E.g., 'private call' with invalid schemaPath will fail, but description does not say 'File not found. Check path and try again.' Agents cannot self-correct.
Descriptions are generic or incomplete. 'Call a tool by name with JSON arguments' does not explain WHEN to use 'call' vs 'private call', what happens on error, or what the return value contains. Baseline: 194 chars avg; most here are 40-80 chars.