Implements Tessl skill review CI/CD pipelines through an interactive, configuration-first wizard. Supports GitHub Actions, Jenkins, and Azure DevOps.
70
90%
Does it follow best practices?
Impact
50%
0.67xAverage score across 6 eval scenarios
Advisory
Suggest reviewing before use
{
"context": "scenario-0",
"type": "weighted_checklist",
"checklist": [
{
"name": "C01",
"description": "A workflow YAML file exists at ~/project/.github/workflows/tessl-skill-review.yml (or a similarly named .yml file in .github/workflows/).",
"max_score": 9
},
{
"name": "C02",
"description": "The workflow file includes a 'pull_request' trigger targeting the 'main' branch.",
"max_score": 7
},
{
"name": "C03",
"description": "The workflow file includes a 'push' trigger targeting the 'main' branch.",
"max_score": 7
},
{
"name": "C04",
"description": "The workflow file includes a 'workflow_dispatch' trigger.",
"max_score": 7
},
{
"name": "C05",
"description": "The pull_request and/or push trigger paths include '**/SKILL.md' and '**/skills/**' (the default trigger paths).",
"max_score": 7
},
{
"name": "C06",
"description": "The workflow has 'permissions' that include 'contents: write' and 'pull-requests: write'.",
"max_score": 7
},
{
"name": "C07",
"description": "The workflow uses actions/checkout pinned to a full SHA hash (e.g. actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5) with fetch-depth: 0.",
"max_score": 7
},
{
"name": "C08",
"description": "The workflow sets up Node.js (via actions/setup-node) and installs the Tessl CLI (npm install -g @tessl/cli).",
"max_score": 7
},
{
"name": "C09",
"description": "The workflow runs 'tessl skill review --json' on detected skill directories.",
"max_score": 7
},
{
"name": "C10",
"description": "The workflow constructs a PR comment body that includes the HTML marker '<!-- tessl-skill-review -->'.",
"max_score": 7
},
{
"name": "C11",
"description": "The PR comment footer text is informational (mentions score is informational / not used for pass/fail gating), since no score threshold was requested.",
"max_score": 7
},
{
"name": "C12",
"description": "There is a cache commit job/step that only runs on push to 'main' and uses the commit message 'chore: update skill review cache [skip ci]'.",
"max_score": 7
},
{
"name": "C13",
"description": "A cache file exists at ~/project/.github/.tessl/skill-review-cache.json with valid JSON containing 'version', 'last_updated', and 'skills' keys.",
"max_score": 7
},
{
"name": "C14",
"description": "Only a single workflow file was created (not two-workflow architecture), appropriate for the internal repository use case.",
"max_score": 7
}
]
}evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6