End-to-end merchant onboarding pipeline for Universal Commerce Protocol (UCP) integration. Orchestrates audit, profile generation, catalog mapping, and validation skills.
Four tools with basic descriptions and partial schemas. All tools have descriptions (10-200 chars), but parameter documentation is inconsistent. Input schemas present but lack comprehensive type definitions and constraints. No output schemas documented. Error handling guidance absent. Tool names follow verb_noun pattern but lack clarity on distinctions (audit_site vs validate_ucp both scan). No tool annotations (readOnlyHint/destructiveHint). Composition is reasonable (each tool has one responsibility), but chaining support is weak, no documented output fields that feed into downstream tools.
UCP Readiness Audit — scans a merchant website and scores UCP readiness. Checks for UCP profile, platform detection, structured data, payment methods, and API accessibility.
Generate a UCP business profile (/.well-known/ucp) for a merchant. Creates profile JSON with services, capabilities, and payment handlers based on merchant configuration.
Map merchant product data to UCP catalog schema format. Supports Shopify (products.json), CSV, and raw JSON sources. Validates output against UCP product schema.
UCP Validation Orchestrator — validates UCP profile against official schema. Checks profile structure, schema compliance, namespace/URL binding rules, spec/schema URL reachability, and reports transport types and capabilities.
No output schemas documented. LLMs cannot infer what fields are returned or plan downstream tool calls. E.g., audit_site and validate_ucp return markdown reports, structure unknown.
Ambiguous tool naming: audit_site and validate_ucp both scan websites for UCP readiness. Descriptions do not clearly distinguish when to use each. LLMs will conflate them.
Parameter descriptions lack format/constraint details. E.g., 'caps' is 'comma-separated capabilities' but no enum or pattern constraint. 'currency' accepts 'ISO 4217 code' but no validation hint. LLMs will guess invalid values.
No error handling guidance. Scripts may fail (network timeouts, invalid URLs, malformed JSON) but tool descriptions do not explain recovery steps or retryability. Agents cannot self-correct.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 45 | 2026-07-28+ | v2 |
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). Agents cannot determine which tools are safe to retry or have side effects. generate_profile and map_catalog write files but lack destructiveHint.