Terraform Upgrade Intelligence CLI - analyzes Terraform configurations against rules packs to identify upgrade paths, breaking changes, and migration requirements
19 tools with significant quality gaps. Most tools have descriptions (good), but parameter schemas are incomplete or missing type definitions. Many parameters lack descriptions entirely. No output schemas documented. Error handling guidance absent. Tool naming is inconsistent: 'fetch providers', 'fetch modules', 'fetch provider-info' are similar but not clearly distinguished. No tool annotations (readOnlyHint/destructiveHint). Composition is poor, 'scan' and 'apply' should be separate, but 'apply' lacks clear prerequisites and error recovery paths. Average tool description ~150 chars (within baseline), but parameter descriptions are sparse or generic.
Applies codemods and state migrations from a rules pack to Terraform configurations. Modifies files in-place and generates state migration scripts.
Ingests Terraform documentation manifest into SQLite catalog database.
Initializes a SQLite database for storing Terraform provider and module documentation metadata.
Analyzes documentation coverage across Terraform providers and modules by reading manifest.jsonl.
Generates a summary JSON manifest from Terraform documentation entries, aggregating coverage statistics by provider and module.
Signs files using Ed25519 private keys. Generates detached signatures in base64 format or JSON bundles with SHA256 hash and signature.
Enriches provider metadata with changelog information from GitHub repositories.
Naming ambiguity: 'fetch providers', 'fetch provider-info', 'fetch providers-all' are similar but not clearly distinguished. LLMs will conflate them. Use 'fetch_provider_versions', 'fetch_provider_metadata', 'fetch_all_providers' for clarity.
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields. Document return types for all 19 tools.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 46 | 2026-07-28+ | v2 |
Fetches detailed module metadata from Terraform Registry and caches it locally.
Fetches module version information from Terraform Registry and caches it locally.
Fetches all modules from Terraform Registry with pagination support. Optionally fetches detailed info for each module.
Fetches provider documentation from Terraform Registry for a specific version.
Fetches detailed provider metadata from Terraform Registry and caches it locally.
Fetches provider version information from Terraform Registry and caches it locally.
Fetches all providers from Terraform Registry with pagination support. Optionally fetches detailed info for each provider.
Generates test templates, Terraform configurations, and rules packs for provider and module upgrade scenarios.
Parses Terraform HCL configurations and dumps the usage graph as JSON, including providers, modules, and their locations.
Scans Terraform configurations against a rules pack to identify upgrade issues, breaking changes, and migration requirements. Supports multiple output formats (table, json, md, sarif) and optional fix mode for generating codemods and state migration plans.
Fetches and validates a rules pack from a local path or file:// URL. Optionally verifies Ed25519 or cosign signatures before caching.
Verifies the integrity and signature of a rules pack file. Validates pack structure, counts rules, and optionally verifies Ed25519 or cosign signatures.
Parameter descriptions missing or generic for many tools. E.g., 'cache' param in fetch_* tools lacks guidance on default behavior, format, or when to use. 'base-url' lacks validation constraints.
No error handling guidance. Tools like 'apply' (WRITE risk) lack recovery paths. E.g., if apply fails mid-operation, how does the agent recover? No compensation tools or rollback guidance.
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). Agents cannot distinguish safe vs. risky tools. 'apply' and 'generator' are destructive but unmarked.