CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl-labs/tessl-skill-review-ci

Implements Tessl skill review CI/CD pipelines through an interactive, configuration-first wizard. Supports GitHub Actions, Jenkins, and Azure DevOps.

70

0.67x
Quality

90%

Does it follow best practices?

Impact

50%

0.67x

Average score across 6 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-3/

{
  "context": "scenario-0",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "C01",
      "description": "A workflow YAML file exists at ~/project/.github/workflows/tessl-skill-review.yml (or a similarly named .yml file in .github/workflows/).",
      "max_score": 9
    },
    {
      "name": "C02",
      "description": "The workflow file includes a 'pull_request' trigger targeting the 'main' branch.",
      "max_score": 7
    },
    {
      "name": "C03",
      "description": "The workflow file includes a 'push' trigger targeting the 'main' branch.",
      "max_score": 7
    },
    {
      "name": "C04",
      "description": "The workflow file includes a 'workflow_dispatch' trigger.",
      "max_score": 7
    },
    {
      "name": "C05",
      "description": "The pull_request and/or push trigger paths include '**/SKILL.md' and '**/skills/**' (the default trigger paths).",
      "max_score": 7
    },
    {
      "name": "C06",
      "description": "The workflow has 'permissions' that include 'contents: write' and 'pull-requests: write'.",
      "max_score": 7
    },
    {
      "name": "C07",
      "description": "The workflow uses actions/checkout pinned to a full SHA hash (e.g. actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5) with fetch-depth: 0.",
      "max_score": 7
    },
    {
      "name": "C08",
      "description": "The workflow sets up Node.js (via actions/setup-node) and installs the Tessl CLI (npm install -g @tessl/cli).",
      "max_score": 7
    },
    {
      "name": "C09",
      "description": "The workflow runs 'tessl skill review --json' on detected skill directories.",
      "max_score": 7
    },
    {
      "name": "C10",
      "description": "The workflow constructs a PR comment body that includes the HTML marker '<!-- tessl-skill-review -->'.",
      "max_score": 7
    },
    {
      "name": "C11",
      "description": "The PR comment footer text is informational (mentions score is informational / not used for pass/fail gating), since no score threshold was requested.",
      "max_score": 7
    },
    {
      "name": "C12",
      "description": "There is a cache commit job/step that only runs on push to 'main' and uses the commit message 'chore: update skill review cache [skip ci]'.",
      "max_score": 7
    },
    {
      "name": "C13",
      "description": "A cache file exists at ~/project/.github/.tessl/skill-review-cache.json with valid JSON containing 'version', 'last_updated', and 'skills' keys.",
      "max_score": 7
    },
    {
      "name": "C14",
      "description": "Only a single workflow file was created (not two-workflow architecture), appropriate for the internal repository use case.",
      "max_score": 7
    }
  ]
}

evals

azure-devops.md

circleci.md

github-actions.md

gitlab-ci.md

jenkins.md

README.md

SKILL.md

tessl-skill-review-ci-review.md

TESTING.md

tile.json