Local-first CloudAgent desktop app suite for operating cloud environments with AI agents. Includes API server, desktop shell, and UI components for AWS cloud management and infrastructure automation.
Critical failures across all dimensions. Tool definitions are inferred from file paths and names only, no explicit schema registration visible in provided source. No input parameter schemas, output schemas, or parameter descriptions found. Tool descriptions are minimal (10-40 chars), far below the 50-200 char baseline for LLM-optimized tools. No error handling guidance, no security annotations, no composition hints. The codebase shows package.json and dependency structure but does NOT expose the actual tool definitions, schemas, or MCP server implementation code needed for evaluation.
Get available architecture templates
Manage CLI sessions for command execution
Get deployment preferences summary
Get or create diagram specifications
Get a scanner artifact by ID
Get a specific permission profile by ID
Get a specific workload by ID
Launch or open a scanner artifact
No input schemas visible. All 13 tools have schema score of 0. Cannot verify parameter types, constraints, or descriptions.
Descriptions are 10-40 characters (e.g., 'List available permission profiles'). Even at 40 chars, these lack WHEN to use, prerequisites, or downstream context. Baseline is 50-200 chars for LLM-optimized tools.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 26 | 2026-07-28+ | v2 |
List available scanner artifacts
List available permission profiles
List available workloads
Check and validate Terraform plans
Update a workload configuration
No output schemas documented. LLMs cannot plan downstream calls or extract required fields. No pagination hints for list_* tools. No indication of what fields are returned or how to chain results.
No error handling guidance. No recovery hints (e.g., 'If workload not found, call list_workloads first'). No categorization of errors as retryable vs fatal. Agents will be stuck on failures.
Destructive tools (update_workload, cli_session, launch_artifact) lack confirmation/dry-run patterns. No indication that these modify state. Agents may execute irreversibly without safeguards.