Visual canvas for wiring MCP tools together, statically type-checked against real JSON Schemas.
toolgraph exposes 3 tools for MCP server introspection and graph execution. Tool naming is clear (introspect, run, health), but descriptions lack depth and parameter documentation is sparse. The 'run' tool has a complex nested schema (graph with nodes/edges) but lacks field-level descriptions. The 'introspect' tool accepts a 'connection' object with 6 properties, but only 3 are documented as required; the 'secrets' object structure is vague. No error handling guidance, no output schema documentation, and no indication of idempotency or side effects. Descriptions are 10-50 chars, below the 50-200 char baseline for LLM-optimized tools.
Health check endpoint for the execution engine
Introspects an MCP server and returns its tools with their JSON Schemas
Executes a graph of connected MCP tools with type-checked connections
Tool descriptions are too short (10-50 chars) and lack context. 'Introspects an MCP server...' does not explain WHEN to call it, WHAT it returns, or HOW to use the output. LLMs cannot determine tool selection from these descriptions.
Parameter descriptions are missing or incomplete. The 'connection' object in introspect has 6 properties but only 3 are marked required; 'secrets' is documented as 'Optional authentication secrets' with no detail on what headers are expected or how they are used.
Output schemas are not documented. Callers do not know what fields introspect returns, what structure the graph execution result has, or what health returns. This forces LLMs to guess and breaks downstream tool chaining.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 47 | 2025-06-18+ | v2 |
No error handling guidance. If introspect fails to connect to a server, or run encounters a type mismatch in the graph, there is no indication of what the error means or how to recover. LLMs receive raw errors with no actionable next steps.
The 'run' tool modifies state (executes graphs, may trigger side effects in connected MCP servers) but the description does not warn of this. LLMs cannot determine if the tool is safe to retry or if it has irreversible consequences.