Self-hosted MCP knowledge server: a read-only, audited view of one operator's own data (a company's, a household's, or one person's), plus the curated context needed to use it correctly.
Tool definitions are inferred from site/.well-known/mcp.json metadata only, no actual implementation code visible. The JSON lists 20 tools with names and brief descriptions (10-50 chars), but NO input schemas, NO parameter definitions, NO output schemas, and NO error handling guidance. Descriptions are too short (avg ~25 chars vs. baseline 194 chars) to guide LLM tool selection. Cannot verify schema compliance, parameter types, or composition patterns. This is a metadata stub, not a production-ready tool definition.
How to build a Setoku app
Full context doc for one entity
Attach a drafted doc-edit to a pending correction
Find context for this connector's data
Inspect an app — its full template and panels
Canonical metric definition
Every table and column you can query
NO INPUT SCHEMAS VISIBLE: All 20 tools lack parameter definitions, types, constraints, and descriptions. Cannot verify LLM can infer valid inputs or compose tool chains.
DESCRIPTIONS TOO SHORT: Average 25 chars (baseline 194 chars). Descriptions like 'List everything in the knowledge store' lack WHEN to use, WHAT it returns, and prerequisites. LLMs cannot reliably select tools with such sparse guidance.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 40 | 2026-07-28+ | v2 |
List apps published to the box
List pending knowledge corrections
List everything in the knowledge store
List connected data sources
Publish a live app to the box
Share a file to the box
Auto-reject a pending correction
Record a context correction / clarification
Resolve a pending correction
Run a read-only SQL query
Archive a published app
Edit an app you published
Create or update a knowledge doc
NO OUTPUT SCHEMAS: Cannot verify what fields tools return, whether pagination is supported, or if downstream tools receive required IDs for chaining. Breaks composition patterns.
WRITE TOOLS LACK CONFIRMATION/DRY-RUN: Tools like publish_app, upsert_context, report_correction modify state but have no documented confirmation or dry-run capability. Agents risk unintended side effects.
NO ERROR HANDLING GUIDANCE: No documentation of what errors tools can raise, how to recover, or what the LLM should do next. Agents will fail silently or retry blindly.