DAG workflow engine with AI-powered nodes — design, run, and deploy workflows from CLI, UI, or code
Stirrup provides 7 tools with clear verb-noun naming (list_, get_, create_, run_, validate_) and reasonable descriptions (avg ~120 chars). All tools have input schemas with type declarations. However, parameter descriptions are sparse or missing entirely, most params lack guidance on format, constraints, or valid values. Output schemas are undocumented. Error handling is minimal; no recovery guidance or actionable error messages visible. The sampling feature (deprecated) is enabled but not critical. Overall: solid foundation, but parameter and output documentation gaps prevent higher scores.
Create a new workflow from a JSON definition. The workflow is validated, saved as YAML, and registered with the engine. Returns the created workflow.
Get the current state of a workflow execution by its execution ID
Get the full definition of a workflow by ID, including all nodes, edges, and configuration
List all available node types with their configuration schemas. Use this to understand what types of nodes can be used in workflows.
List all available workflow definitions with their IDs, names, descriptions, and parameter info
Execute a workflow by ID with the given parameters. Returns the full execution state including all step outputs.
Parameter descriptions missing or minimal. 'workflow' param in create_workflow and validate_workflow lacks format guidance (JSON string? YAML? schema constraints?). 'params' in run_workflow says 'JSON object' but no schema for expected keys or types.
Output schemas completely undocumented. No description of what list_workflows, get_workflow, get_execution, or list_node_types return. LLMs cannot plan downstream tool calls or extract required fields without knowing response structure.
No error handling guidance. Tools lack descriptions of failure modes, recovery steps, or actionable error messages. E.g., create_workflow does not explain what validation errors look like or how to fix them.
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | C | 60 | <=2025-11-25 | v2 |
Validate a workflow definition JSON without saving or executing it. Returns validation errors or confirms it's valid.
Destructive operations (create_workflow, run_workflow) lack confirmation or dry-run support. No indication in descriptions that these modify state or have side effects. Agents cannot distinguish safe reads from risky writes.
Pagination not visible. list_workflows and list_node_types lack limit, offset, or cursor parameters. Large result sets could exhaust context window without pagination support.