CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl-labs/tessl-skill-review-ci

Implements Tessl skill review CI/CD pipelines through an interactive, configuration-first wizard. Supports GitHub Actions, Jenkins, and Azure DevOps.

70

0.67x
Quality

90%

Does it follow best practices?

Impact

50%

0.67x

Average score across 6 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

TESTING.md

Testing Instructions

After setup is complete, provide these testing instructions to the user.

Quick Test: Manual Trigger

Test the workflow immediately without making code changes:

# Get repository info for URL construction
REPO_URL=$(git remote get-url origin | sed 's/\.git$//' | sed 's|git@github.com:|https://github.com/|')

echo "Test the workflow now:"
echo "1. Go to: ${REPO_URL}/actions/workflows/tessl-skill-review.yml"
echo "2. Click 'Run workflow' button"
echo "3. Select branch: {{TARGET_BRANCH}}"
echo "4. Click 'Run workflow'"
echo ""
echo "What to verify:"
echo "✅ Workflow runs without errors"
echo "✅ Review scores appear in workflow summary"
echo "✅ Cache file was created/updated at: {{CACHE_FILE}}"

Comprehensive Test: Pull Request Flow

Test the complete PR workflow with score diff tracking:

1. Create test branch:
   git checkout -b test/skill-review-setup

2. Modify a SKILL.md file (add a word to the description):
   echo "Updated for testing" >> path/to/SKILL.md

3. Commit and push:
   git add path/to/SKILL.md
   git commit -m "test: trigger skill review workflow"
   git push -u origin test/skill-review-setup

4. Create Pull Request on GitHub

5. Wait for workflow to run (check Actions tab)

6. Verify PR comment appears with:
   ✅ Review results table
   ✅ Score percentages
   ✅ Detailed evaluations in expandable sections

7. Merge the PR to {{TARGET_BRANCH}}

8. Verify cache auto-committed:
   git pull origin {{TARGET_BRANCH}}
   git log --oneline -5
   # Look for: "chore: update skill review cache [skip ci]"

9. Create another PR with same skill
   ✅ Score diff indicators appear (🔺 🔻 ➡️)
   ✅ Previous vs Current scores shown

What to Look For

Successful Setup:

  • ✅ Workflow runs without errors
  • ✅ Review scores appear in output
  • ✅ Cache file gets populated with skill data
  • ✅ PR comments show formatted review results
  • ✅ Score diff shows on subsequent runs
  • ✅ Cache auto-commits to {{TARGET_BRANCH}} after PR merge

Common Issues:

IssueSolution
Workflow fails immediatelyCheck that TESSL_API_KEY is set in GitHub Secrets
No PR comment appearsVerify pull-requests: write permission in workflow
Cache not committingCheck that contents: write permission is set
Score diff not showingEnsure cache file exists and has previous run data

azure-devops.md

circleci.md

github-actions.md

gitlab-ci.md

jenkins.md

README.md

SKILL.md

tessl-skill-review-ci-review.md

TESTING.md

tile.json