CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl-labs/tessl-skill-review-ci

Implements Tessl skill review CI/CD pipelines through an interactive, configuration-first wizard. Supports GitHub Actions, Jenkins, and Azure DevOps.

70

0.67x
Quality

90%

Does it follow best practices?

Impact

50%

0.67x

Average score across 6 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

task.mdevals/scenario-1/

Task: Automate Skill Quality Reviews in Our Jenkins CI Environment

Our team uses Jenkins (Multibranch Pipeline) for all CI/CD. We have a private GitHub repository at ~/project where we store Tessl skills. We need a Jenkinsfile that automatically reviews skill quality.

Configuration (use these values directly — do not ask configuration questions)

  • CI Platform: Jenkins (Multibranch Pipeline)
  • Architecture: Single-pipeline (all trusted internal contributors)
  • Target branch: main
  • Cache location: .tessl/skill-review-cache.json (default for Jenkins)
  • Score threshold: 80% — any skill scoring below this should fail the build

What the pipeline should do

  1. Detect changed SKILL.md files in PRs (compared against target branch)
  2. For pushes to main or manual builds, review all skills in the repository
  3. Run tessl skill review --json on each detected skill
  4. Calculate review scores and compare against cached previous scores
  5. Post a formatted PR comment (via GitHub API) showing results with score diff indicators
  6. Score quality gate: fail the build if any skill scores below 80%
  7. Cache score results and auto-commit the cache to main after merges

Current repository structure

~/project/
  .git/
  skills/
    incident-response/SKILL.md
    kubernetes-ops/SKILL.md
  src/
    app.py

Expected output files

  1. ~/project/Jenkinsfile — declarative pipeline
  2. ~/project/.tessl/skill-review-cache.json — initialized cache file

Write all output files to the ~/project directory. Do not run or test the pipeline.

evals

scenario-1

criteria.json

task.md

azure-devops.md

circleci.md

github-actions.md

gitlab-ci.md

jenkins.md

README.md

SKILL.md

tessl-skill-review-ci-review.md

TESTING.md

tile.json