All 13 tools have basic descriptions and parameter schemas, but quality is inconsistent. Descriptions are generic (avg ~80 chars, well below the 194-char baseline for A+ tools) and lack context on WHEN to use each tool or what distinguishes similar ones (e.g., get_pods vs describe_pod). Parameter descriptions are minimal, 'The CLI tool to use' repeats across all tools without explaining why an agent would choose 'oc' over 'kubectl'. No output schemas documented. No error handling guidance. No tool annotations (readOnlyHint, etc.). All tools are read-only and safe, but the definitions do not leverage this for agent optimization. Schema validation is present (command enum check) but only at runtime, not in the JSON Schema definition.
Describe a specific configmap in the Kubernetes or OpenShift cluster.
Describe a specific daemonset in the Kubernetes or OpenShift cluster.
Describe a specific KataConfig object in the Kubernetes or OpenShift cluster.
Describe a specific pod in the Kubernetes or OpenShift cluster.
Get the list of nodes in the Kubernetes or OpenShift cluster.
Get the list of configmaps in the Kubernetes or OpenShift cluster.
Get the list of daemonsets in the Kubernetes or OpenShift cluster.
No output schemas documented. Tools return raw subprocess stdout (strings) with no structure. LLMs cannot parse results reliably or extract IDs for chaining.
Descriptions are generic and do not explain WHEN to use each tool or how it differs from similar ones. E.g., 'Get the list of pods' vs 'Describe a specific pod' lacks guidance on which to call first or when each is appropriate.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 44 | 2026-07-28+ | v2 |
Get the list of installed operators in the Kubernetes or OpenShift cluster.
Get the logs of a specific job in the Kubernetes or OpenShift cluster.
Get the list of jobs in the Kubernetes or OpenShift cluster.
Get the status of the KataConfig object in the Kubernetes or OpenShift cluster.
Get the logs of a specific pod in the Kubernetes or OpenShift cluster.
Get the list of pods in the Kubernetes or OpenShift cluster.
Parameter descriptions lack actionable detail. 'The CLI tool to use' repeats 13 times without explaining why an agent would choose 'oc' vs 'kubectl' or what context determines the choice. No guidance on prerequisites or dependencies.
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). All tools are read-only and safe to retry, but this is not declared in the schema. Agents cannot optimize retry logic or safety assumptions.
No error handling guidance. Tools return raw subprocess output or error strings without actionable recovery steps. E.g., 'Error: Invalid CLI tool specified' does not guide the agent on what to do next.