Manifest-driven MCP server scaffolder and runtime hub for Claude tool integrations
mcp-factory is a manifest-driven MCP server scaffolder and runtime hub, not a production tool provider. The 4 tools present are either demo/fixture tools or test utilities. Tool definitions lack proper schemas, have minimal descriptions (under 50 chars), and parameters are either missing or lack type information. The say_hello tool is explicitly marked as a demo with a disclaimer. The ping, echo, and crash tools are from test fixtures, not production-grade integrations. No parameter type definitions are visible in the source. Descriptions are generic and do not meet the 10 - 1024 character expectation for clarity. Error handling is minimal. This server's purpose is scaffolding and hub management, not exposing user-facing tools, the low score reflects that the tools are illustrative rather than production-quality.
Always returns an error
Echo a message
Ping the server
[DEMO] Hello, {who}! This is mcp-factory-demo, a bundled example bot -- not a real integration. It only ever serves when no real mcp.yaml manifests are found (set MCP_FACTORY_NO_DEMO=1 or pass --no-demo to disable it).
ping tool has empty input schema (no parameters defined) and minimal description ('Ping the server'). Does not meet 10 - 1024 character description range or parameter clarity requirements.
crash tool has empty input schema and description under 20 characters ('Always returns an error'). No guidance on error classification or recovery path. Violates error-handling and description clarity baselines.
say_hello tool description is primarily a disclaimer about demo mode rather than a description of what the tool does or when to call it. Does not follow 'WHAT, WHEN, prerequisites' pattern for descriptions.
No parameter type definitions visible in source. The say_hello 'name' parameter and echo 'message' parameter are listed in inline schemas but lack explicit JSON Schema type declarations in the tool registration code.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 30 | 2026-07-28+ | v2 |
ping and crash tools have empty parameter objects but no documented output schema. LLMs cannot infer what these tools return or how to chain them with other tools.
All tools are fixture/demo tools from test or demo modules, not production integrations. Tool definitions appear inferred rather than explicitly registered with full schemas in the main codebase.