AI agent for grandMA2 lighting consoles — 218 MCP tools via Telnet (fork of ma2-onPC-MCP)
MA2 Agent has 5 tools with mixed quality. All tools have descriptions (10-200 chars, within baseline range) and input schemas with typed parameters. However, schemas lack depth: no enums for constrained inputs, minimal parameter descriptions (many under 20 chars), no documented output schemas, and no error handling guidance. Tool names follow verb_noun pattern (decompose_task, run_task, list_agent_sessions, recall_agent_session, agent_token_report) but lack clarity on when to use each. The run_task tool accepts auto_confirm_destructive but provides no confirmation/dry-run pattern. Descriptions mention 'prefer plan_agent_goal and run_agent_goal' (tools not in this list), suggesting incomplete tool surface exposure. No evidence of pagination support, result limits, or chaining IDs in responses.
Report token consumption across recent agent sessions.
Break a high-level lighting goal into an ordered rule-based plan. Returns the plan summary and full step list so you can review before executing. Call run_task to actually execute. For the richer agent harness in src/server.py, prefer plan_agent_goal and run_agent_goal.
List recent multi-agent task sessions from long-term memory.
Restore the full WorkingMemory snapshot from a past agent session.
Execute a full rule-based orchestration task from a natural-language goal. Orchestrates sub-agents with risk-tier isolation, working memory, and per-step evaluation. For the richer agent harness in src/server.py, prefer run_agent_goal.
No output schemas documented. LLMs cannot plan downstream calls or extract required fields (e.g., session_id from list_agent_sessions). Baseline: 100% of A+ tools document return types.
Parameter descriptions are minimal or missing. 'limit' in list_agent_sessions and agent_token_report lacks range constraints (e.g., 1 - 100). 'session_id' in recall_agent_session has no format hint (8-char format mentioned in description, not schema). Baseline: 100% of A+ tool params have descriptions; 94% of A+ tools have docstrings.
run_task accepts auto_confirm_destructive boolean but provides no dry-run or confirmation step. Agents cannot preview destructive actions before executing. Pattern: confirmation-request.
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 47 | <=2025-11-25 | v2 |
No enums for constrained inputs. 'color' accepts free-form strings (hex or name) with no enum or pattern. 'group' and 'preset' similarly unconstrained. Baseline: constrained inputs use enums to prevent hallucinated values.
Descriptions reference tools not in this list ('plan_agent_goal', 'run_agent_goal'). Suggests incomplete tool surface or documentation mismatch. LLMs may attempt to call non-existent tools.