Open-source data integration framework with tool execution, workflow orchestration, and multi-system integration capabilities
Superglue exposes a single tool 'search_documentation' with acceptable naming and schema structure. However, the tool lacks critical context for production use: no documented output schema, no error handling guidance, and no explanation of what 'documentation' refers to (API docs? Internal wiki? User manual?). The description is 257 characters (within baseline 194±158), but uses vague language ('relevant documentation excerpts') without explaining what data structure is returned or how the LLM should interpret results. The input parameter 'query' is well-typed (string) and described, meeting basic parameter standards, but the tool is fundamentally underspecified for reliable agent composition. The tool appears to be registered directly in llm-tools.ts, but without visible output schema declaration in the source, the tool cannot guide downstream planning or chaining.
Search documentation for specific information about API structure, endpoints, authentication patterns, etc. Use this when you need to understand how an API works, what endpoints are available, or how to authenticate. Returns relevant documentation excerpts matching your search query.
No documented output schema. Tool description promises 'relevant documentation excerpts matching your search query' but does not specify the return type (array of strings? objects with title+body? metadata?). LLMs cannot chain this tool to downstream operations without knowing what fields are available.
Vague tool and parameter context. The tool is named 'search_documentation' but the description never clarifies WHICH documentation system is being queried (API documentation? Internal knowledge base? Scraped web content? The Dockerfile comments mention 'documentation scraping' via Playwright, but this is not mentioned in the tool definition). The 'query' parameter description is generic and does not explain search behavior (substring match? semantic search? regex?).
No error handling guidance. The tool declares risk: READ_ONLY (good), but provides no recovery hints for failure cases: What if the documentation is not indexed? What if the query returns no results? Should the LLM retry with a different query, or are there alternative tools?
Inferred effective spec: 2026-07-28+.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-22 | D | 58 | 2026-07-28+ | v2 |
| 2026-03-09 | F | 34 | - | v1 |
Input schema is minimal but correct. The parameter 'query' is typed as string with a description, meeting the baseline. However, no constraints are documented: Is there a minimum/maximum length? Are there unsupported characters? The description provides examples ('authentication', 'batch processing', 'rate limits') but per the rubric, examples in descriptions can lead LLMs to treat them as the only valid values, use enums or format constraints instead.
Single tool is insufficient for realistic agent tasks. Superglue appears to be a workflow/integration platform (based on Dockerfile evidence: Deno workers, Playwright scraping, tool execution), yet exposes only one LLM tool. This suggests either incomplete integration or that the MCP server is not the primary API surface. If this is an MCP server, it should expose tools for: creating/managing workflows, triggering executions, querying results, managing documentation sources, etc.