Distributed vector memory, hardware-enforced domain firewall, and NAT-traversing execution mesh for multi-instance Hermes fleets
Server has 12 tools with complete input schemas and descriptions, but quality is inconsistent. Naming follows verb_noun convention well (fleet_memory_search, fleet_task_submit, desktop_bridge_execute). However, descriptions are often generic and lack actionable context for LLM selection. Parameters are typed but many lack detailed constraints or format guidance. No output schemas documented. Error handling is absent from tool definitions. Security-critical tools (desktop_bridge_execute, fleet_memory_delete) lack confirmation patterns or permission documentation. Composition is reasonable, tools are single-purpose, but chaining metadata (IDs needed for follow-up calls) is not evident in descriptions.
Create a ZIP archive of a directory with size and file count limits, returning a download URL.
Download a file from the local filesystem via the desktop bridge with path validation and sensitive file blocking.
Execute an allowlisted command on the local desktop bridge with strict binary and argument validation.
Query local system telemetry including GPU status, network interfaces, running processes, and disk usage.
Delete a memory point from fleet memory by ID.
List all available memory domains and their access permissions based on hardware-enforced domain firewall.
Search fleet memory on-demand via vector similarity. Query domain is hardware-enforced by host OS configuration.
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields (e.g., point_id from fleet_memory_store, task_id from fleet_task_submit). Responses are unstructured.
Destructive tools (fleet_memory_delete, desktop_bridge_execute) lack confirmation patterns, dry-run options, or permission documentation. Agents can delete data or execute commands without safeguards.
Parameter descriptions lack format constraints and validation rules. E.g., 'target_domain' accepts 'personal, work, shared, or all' but no enum constraint visible; 'ttl_seconds' has max 300 but no min specified; 'action' in desktop_bridge_execute lists examples but no enum.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 47 | 2026-07-28+ | v2 |
Get statistics about fleet memory collection including point count, vector dimensions, and domain distribution.
Store a memory vector in fleet memory with domain isolation and optional knowledge graph extraction.
List pending and recent tasks for the authenticated node.
Query the status of a submitted fleet task by task ID.
Submit a task to the fleet control plane for execution on a target node.
No error handling guidance in tool definitions. LLMs cannot determine if failures are retryable, user-fixable, or fatal. No recovery suggestions provided.
Tool descriptions are generic and lack context for LLM selection. E.g., 'Query the status of a submitted fleet task by task ID' does not explain when to use this vs fleet_task_list, or what the response contains.