CtrlK
BlogDocsLog inGet started
Tessl Logo

pantheon-ai/helm-toolkit

Complete helm toolkit with generation and validation capabilities

94

Quality

94%

Does it follow best practices?

Impact

Pending

No eval scenarios have been run

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsonvalidator/evals/scenario-1/

{
  "context": "Agent correctly identifies structural and lint issues in a minimal Helm chart missing recommended files and using deprecated Chart.yaml fields.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Required file presence check",
      "description": "Agent correctly identifies Chart.yaml, values.yaml, and templates/ as present.",
      "max_score": 10
    },
    {
      "name": "Missing recommended files identified",
      "description": "Agent identifies that _helpers.tpl, NOTES.txt, and .helmignore are missing and categorises them as Warnings or Info.",
      "max_score": 20
    },
    {
      "name": "Deprecated apiVersion flagged",
      "description": "Agent flags Chart.yaml using apiVersion: v1 instead of the Helm 3+ required apiVersion: v2 as an Error.",
      "max_score": 20
    },
    {
      "name": "Image :latest tag flagged",
      "description": "Agent flags values.yaml image.tag: latest as a Warning with a recommendation to pin to a specific tag.",
      "max_score": 20
    },
    {
      "name": "Read-only posture maintained",
      "description": "Agent proposes all fixes but does not modify any files. All proposed changes are listed in a summary section only.",
      "max_score": 15
    },
    {
      "name": "Issue categorisation",
      "description": "Agent correctly categorises each finding as Error (must fix), Warning (should fix), or Info using the three-tier scheme from Stage 10.",
      "max_score": 15
    }
  ]
}

tile.json