CtrlK
BlogDocsLog inGet started
Tessl Logo

pantheon-ai/terragrunt-toolkit

Complete terragrunt toolkit with generation and validation capabilities

93

Quality

93%

Does it follow best practices?

Impact

Pending

No eval scenarios have been run

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsonvalidator/evals/scenario-4/

{
  "context": "Agent identifies all deprecated Terragrunt syntax across a Makefile and two HCL files and provides correct 0.93+ replacements.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "run-all → run --all migration identified",
      "description": "Agent identifies all three 'run-all' usages in the Makefile as deprecated and provides the 'run --all' replacement commands.",
      "max_score": 20
    },
    {
      "name": "TERRAGRUNT_LOG_LEVEL → TG_LOG migration identified",
      "description": "Agent identifies TERRAGRUNT_LOG_LEVEL as a deprecated environment variable and states TG_LOG=debug (or --terragrunt-log-level → --log-level) as the replacement.",
      "max_score": 20
    },
    {
      "name": "retryable_errors → errors block migration identified",
      "description": "Agent identifies retryable_errors as deprecated and provides an equivalent errors { retry { ... } } block as the 0.93+ replacement.",
      "max_score": 25
    },
    {
      "name": "skip → exclude block migration identified",
      "description": "Agent identifies 'skip = true' as deprecated and provides an equivalent 'exclude { if = true; actions = [\"all\"] }' block.",
      "max_score": 20
    },
    {
      "name": "Behaviour differences explained",
      "description": "Agent explains at least one behaviour difference, such as the exclude block supporting fine-grained action targeting (e.g., only blocking destroy) rather than the binary skip flag.",
      "max_score": 15
    }
  ]
}

tile.json