Validates all CI skills in this repo. Checks Agent Skills spec compliance, gh-aw workflow compilation, permission correctness, and structural conventions. Use when CI skills have been added or modified and you want to verify they compile and conform before committing.
85%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
Passed
No findings from the security scan
Validates all CI skills (*-ci) in this repo. Runs spec validation, compiles gh-aw workflows, and checks CI-specific conventions.
gh-aw to a new version (API changes may break workflows)gh-aw CLI installed (gh extension install github/gh-aw)python3 with pyyaml installedquick_validate.py available at .claude/skills/skill-creator/scripts/Run quick_validate.py on every CI skill:
for d in skills/*-ci/; do
python3 .claude/skills/skill-creator/scripts/quick_validate.py "$d"
doneExtract workflow blocks from each CI skill's references/workflow-example.md and compile with gh aw compile:
# Extract markdown code blocks with frontmatter
# Copy to temp .github/workflows/
# Run: gh aw compilePass criteria: Zero compilation errors. Warnings are reported but don't fail.
CI workflows in strict mode must NOT use write permissions directly. Verify:
issues: write (use safe-outputs: add-comment instead)pull-requests: write (use safe-outputs: create-pull-request-review-comment instead)contents: write unless the workflow creates files (eval-creator create mode)| Check | Rule | Severity |
|---|---|---|
Has references/workflow-example.md | Required for all CI skills | Error |
| Workflow example has frontmatter block | At least one ```markdown block with --- | Error |
| Name matches folder | Frontmatter name == directory name | Error |
| Description mentions gh-aw | CI skills should reference gh-aw | Warning |
| Has corresponding interactive skill | foo-ci should have a foo counterpart | Warning |
For workflows that use call-workflow:
workflow_call in its on: section## CI Skill Test Results
**Date:** YYYY-MM-DD
**gh-aw version:** vX.Y.Z
**Skills tested:** N
**Passed:** N
**Compile errors:** N
**Spec failures:** N
### Compilation Results
- [skill-name]: ✓ compiled (N KB) | ✗ error: [message]
### Spec Results
- [skill-name]: ✓ valid | ✗ [error]
### Permission Issues
- [skill-name]: [issue]Invoke manually:
/skill-tester-ciOr run the script directly:
bash skills/skill-tester-ci/scripts/run-tests.shskill-tester for those)pskoett/pskoett-ai-skills
878b0e4
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.