Loading ToolBench
Model Context Protocol server for Datto BCDR (Backup Portal) — provides tools for interacting with Datto BCDR appliances, backups, recovery points, screenshots, alerts, and activity logs
Server has 10 well-named tools with consistent verb_noun patterns (list_, get_). All tools include descriptions (avg ~80 chars, within baseline 34-392). Input schemas are present and typed for all tools. However, parameter descriptions are minimal (often 1-2 phrases), output schemas are undocumented, and error handling guidance is absent. Elicitation support for optional parameters (serialNumber in list_assets, date ranges in list_alerts/list_activity) is a positive pattern match, but lacks recovery guidance when elicitation fails. No tool annotations (readOnlyHint, etc.) despite all being READ_ONLY operations.
Get details for a specific protected agent on an appliance.
Get details for a specific BCDR appliance by serial number.
Get off-site sync status for an appliance.
Fetch a specific screenshot verification PNG. Returns base64-encoded image content.
List activity log entries. If date range is omitted, the user will be prompted.
List partner portal alerts. If date range is omitted, the user will be prompted to choose a window.
Output schemas undocumented. No tool returns a documented response structure. LLMs cannot plan downstream calls or extract required fields (e.g., does list_devices return device_id, serial_number, or both?). Baseline: 100% of A+ tools document return types.
No tool annotations despite all tools being READ_ONLY. Missing readOnlyHint metadata. Agents cannot distinguish safe tools from destructive ones without explicit hints. Current spec (2026-07-28) rewards tool annotations.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | C | 67 | 2026-07-28+ | v2 |
List protected agents (assets) on a BCDR appliance. If serialNumber is omitted, the user will be prompted to choose or enter one.
List recovery points / backups for a protected agent on an appliance.
List all SIRIS/Alto BCDR appliances in the partner portal.
List screenshot verifications for a protected agent.
Parameter descriptions are minimal (1-2 phrases). E.g., 'Appliance serial number' lacks format guidance, valid range, or examples. Baseline: 94% of A+ tools have rich param annotations (avg 72 chars). Current descriptions average ~20 chars.
No error handling guidance. Tools do not document what errors are retryable, user-fixable, or fatal. E.g., if serialNumber is invalid, should the LLM retry, ask the user, or call list_devices first? No recovery path specified.
Pagination parameters (page, perPage) lack constraints. No documented min/max, no guidance on total count or next_cursor. Baseline: paginated tools should return total count and support cursor-based navigation for large result sets.