Load testing and API pipeline orchestration platform with distributed runner support, Kubernetes integration, and local CLI tooling
Previa exposes 6 load-testing tools with basic descriptions and minimal input schemas. All tools have descriptions (10-100 chars), but most lack parameter detail. Schemas are present but sparse: 3 tools have no input parameters (health, load_ok, metrics, reset_metrics), while load_slow and load_fail accept single integer parameters with descriptions. No output schemas documented. Tool names follow verb_noun convention (load_*, reset_*) and are clear. Error handling and recovery guidance are absent. Composition is reasonable, each tool has one responsibility, but parameter constraints (ranges, defaults) are underspecified. No tool annotations (readOnlyHint/destructiveHint) despite clear risk classifications in metadata.
Returns health status of the load target service
Simulates a failing HTTP request with configurable failure rate and records metrics
Simulates a successful HTTP request and records metrics
Simulates a slow HTTP request with configurable delay and records metrics
Returns aggregated load test metrics including request counts, latency, and per-second statistics
Resets all accumulated load test metrics and restarts collection
No output schemas documented. Tools return aggregated metrics and health status, but LLMs cannot infer response structure (fields, types, nesting). Agents cannot plan downstream calls or extract specific fields reliably.
Parameter descriptions lack constraints. load_slow 'ms' parameter states 'optional, default 50, max 30000' but no minimum specified. load_fail 'rate' parameter states 'range 1-100' but no default behavior if omitted. LLMs cannot validate inputs or understand edge cases.
No error handling or recovery guidance. Tools lack descriptions of failure modes (e.g., what happens if load target is unreachable? What should the agent do?). No actionable error messages defined.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | C | 67 | 2026-07-28+ | v2 |
Tool annotations missing. Metadata declares risk classifications (READ_ONLY, WRITE) but tools lack MCP destructiveHint/readOnlyHint annotations. Agents cannot infer safety properties from the protocol.
Descriptions are terse (10-100 chars). Baseline for A+ tools is 50-200 chars. Current descriptions lack context on WHEN to use each tool, dependencies, or expected outcomes. E.g., 'Simulates a successful HTTP request' does not explain what metrics are recorded or how to interpret results.