Implements Tessl skill review CI/CD pipelines through an interactive, configuration-first wizard. Supports GitHub Actions, GitLab CI, Jenkins, Azure DevOps, and CircleCI.
94
Quality
90%
Does it follow best practices?
Impact
100%
1.75xAverage score across 5 eval scenarios
{
"context": "Tests whether the agent correctly generates a GitHub Actions workflow for skill review in a private repo, using single-workflow architecture with proper cache location, template structure, and configuration documentation.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Single workflow chosen",
"description": "Uses single-workflow architecture (not two-workflow) since the repo is private/internal",
"max_score": 10
},
{
"name": "Correct cache path",
"description": "Cache file path is .github/.tessl/skill-review-cache.json (GitHub Actions specific location)",
"max_score": 10
},
{
"name": "Cache JSON structure",
"description": "Cache file is initialized with {\"version\": \"1\", \"last_updated\": \"\", \"skills\": {}}",
"max_score": 10
},
{
"name": "PR write permission",
"description": "Workflow includes pull-requests: write permission for PR commenting",
"max_score": 8
},
{
"name": "Contents write permission",
"description": "Workflow includes contents: write permission for cache commits",
"max_score": 8
},
{
"name": "Score diff tracking",
"description": "Workflow includes cache comparison logic with previous scores and diff indicators",
"max_score": 10
},
{
"name": "JSON review flag",
"description": "Uses tessl skill review --json for structured output parsing",
"max_score": 8
},
{
"name": "Skip CI in cache commit",
"description": "Cache commit message includes [skip ci] to prevent infinite loops",
"max_score": 8
},
{
"name": "Trigger paths configured",
"description": "Workflow triggers on changes to **/SKILL.md or **/skills/** paths",
"max_score": 8
},
{
"name": "Main branch target",
"description": "Pipeline targets the main branch for triggers and cache commits",
"max_score": 8
},
{
"name": "TESSL_API_KEY instructions",
"description": "Setup notes mention adding TESSL_API_KEY as a GitHub repository secret",
"max_score": 6
},
{
"name": "Config summary present",
"description": "config-summary.md documents the CI platform choice, architecture decision, and default settings",
"max_score": 6
}
]
}Install with Tessl CLI
npx tessl i tessl-labs/tessl-skill-review-cievals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5