CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

self-healing-ci

CI-only self-healing workflow using gh-aw (GitHub Agentic Workflows) for active runtime recovery on pull requests and scheduled runs. When a CI check fails (test, build, lint, deploy, scan), this skill diagnoses the failure from CI logs, proposes a verified patch as a PR comment or follow-up commit, and commits a HEAL entry to `.learnings/HEALS.md`. Verify-before-persist discipline preserved: a HEAL is only `verified` if a re-run check passes in the same workflow; otherwise it ships as `pending-verify` for human follow-up. Recurrent heal patterns across PRs accumulate `Recurrence-Count` and append a `Handoff` block at ≥3 to flag promotion via self-improvement-ci. Use this skill when: you want headless heal-loop execution in CI/scheduled pipelines, you want recurring failure patterns captured automatically, or you want PRs that surface non-obvious environmental / tooling fixes without human triage. For interactive/local sessions, use `self-healing` instead.

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

The canonical home for this skill is self-healing-ci in pskoett/pskoett-ai-skills

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-engineered CI skill body: a numbered contract with mandatory verification, a complete machine-readable output schema, concrete thresholds and loop guards, and a clean one-level split into the workflow-example reference. The main defects are a dangling reference to a HEALS.md 'bootstrap pattern' that the reference file does not contain, and some repetition of the verify discipline across sections.

Suggestions

Fix the dangling reference in Prerequisites: either add a first-run HEALS.md bootstrap snippet (minimal file header + one example HEAL- entry) to references/workflow-example.md, or point Prerequisite 4 at the sibling self-healing skill where the file format actually lives.

Include a minimal HEAL- entry template (the HEALS.md markdown format, not just the YAML output schema) so the CI skill is self-contained; currently a CI agent must read ../self-healing/SKILL.md to know what it is committing.

Trim the verify-before-persist restatements — the Purpose bullets, CI Contract items 3/5, and the Verify-Before-Persist section each restate the same rule; consolidating to the CI Contract plus one cross-reference would reclaim tokens without losing the discipline.

DimensionReasoningScore

Conciseness

The body is efficient and assumes Claude's competence — no explanations of what CI, GitHub Actions, or lockfiles are; sections are compact and tables carry weight ("`pnpm test` failed | Re-run `pnpm test` after the patch"). Minor over-explanation that could be trimmed: the verify-before-persist discipline is restated in the Purpose bullets, CI Contract items 3 and 5, the Verify-Before-Persist section, and Anti-Patterns 1 and 3, and "**Never fake `verified`.** Faking is the exact failure mode this skill exists to prevent…" is rhetorical emphasis. Not 5 because of that repetition; not 3 because the padding is minor and each section still adds distinct operational content.

4 / 5

Actionability

Mostly executable guidance: copy-paste install commands ("gh extension install github/gh-aw"), a fully specified machine-readable YAML output schema with realistic field values, concrete recurrence thresholds ("`Recurrence-Count >= 3`", "at least 2 distinct PRs/tasks", "30-day window"), real GitHub event triggers ("`workflow_run` (completed, conclusion: failure)"), and a concrete loop guard ("`if: github.actor != 'github-actions[bot]'`"). Not 5 because Prerequisite 4 points to a bootstrap pattern that does not exist — "see `references/workflow-example.md` for the bootstrap pattern" for creating `.learnings/HEALS.md` on first run, but that file contains only workflow templates, patch conventions, and permission/anti-loop checklists, leaving the first-run case without concrete coverage. Not 3 because everything else is concrete and executable, not pseudocode.

4 / 5

Workflow Clarity

The multi-step loop is clearly sequenced with explicit validation checkpoints and error-recovery feedback loops: the numbered CI Contract ("1. Read CI logs, PR diff… 2. Avoid direct code modifications… 3. Re-run the failing check after applying the proposed patch…"), the Verify-Before-Persist table mapping each failure class to its re-run, the explicit fallback when verification is infeasible ("ships as `pending-verify` with explicit notes on what would prove it"), and the Anti-Patterns checklist ("Re-trigger loops… Silent retry of flaky tests"). This matches anchor 5's requirement of sequence + validation + feedback loops + checklist, which matters here since the skill can auto-commit to PR branches. Not 4 because validation is not merely present — it is the organizing principle, with a defined failure path when it cannot run.

5 / 5

Progressive Disclosure

Scored against the actual bundle (SKILL.md + `references/workflow-example.md`): the split is appropriate — contract, schema, and rules inline; authoring templates and permission/anti-loop checklists in the single one-level-deep reference, clearly signaled ("Authoring patterns and example `.github/workflows/*.lock.yml` files live in [`references/workflow-example.md`]… Keep example workflows out of `.github/workflows` until you've explicitly decided to enable CI automation"), and the reference links back without nesting. Not 5 because the body's Prerequisite 4 cites a "bootstrap pattern" in that reference which is not actually there, a navigation defect for a reader following the pointer. Not 3 because the structure and signaling are otherwise clean, not buried or monolithic.

4 / 5

Total

17

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it states the full capability loop concretely, gives an explicit multi-clause 'Use this skill when' trigger, and cleanly disambiguates the CI variant from the interactive `self-healing` skill. The only deductions are the second-person phrasing inside the trigger clause and a few missing natural synonyms like 'flaky tests' or 'broken build'.

DimensionReasoningScore

Specificity

The description lists multiple concrete, specific actions — "diagnoses the failure from CI logs, proposes a verified patch as a PR comment or follow-up commit, and commits a HEAL entry to `.learnings/HEALS.md`", plus the verified/pending-verify distinction and the "`Recurrence-Count`… `Handoff` block at ≥3" promotion rule — which is anchor-5 coverage. However, the trigger clause uses second-person voice ("Use this skill when: you want headless heal-loop execution… you want recurring failure patterns captured"), and the guideline explicitly reduces specificity by 1 for second-person usage, bringing it to anchor 4: several specific actions with minor gaps. Not 3 because the capability description itself is fully third-person and far more concrete than 1-2 actions.

4 / 5

Completeness

Both questions are answered explicitly: the "what" is the diagnose → patch → verify → file loop stated concretely ("diagnoses the failure from CI logs, proposes a verified patch… commits a HEAL entry to `.learnings/HEALS.md`"), and the "when" is an explicit enumerated trigger clause: "Use this skill when: you want headless heal-loop execution in CI/scheduled pipelines, you want recurring failure patterns captured automatically, or you want PRs that surface non-obvious environmental / tooling fixes without human triage." It even adds a negative trigger ("For interactive/local sessions, use `self-healing` instead"), matching the anchor-5 example pattern exactly. Not 4 because the when-clause is fully explicit with concrete triggers, not merely present.

5 / 5

Trigger Term Quality

Good keyword coverage with natural phrases users would actually say: "CI check fails", "test, build, lint, deploy, scan", "pull requests", "scheduled runs", "recurring failure patterns", "environmental / tooling fixes", "human triage". Not 5 because common synonyms and file-extension triggers are missing — e.g. "flaky tests", "broken build", "red CI", "fix CI", ".github/workflows" — so it falls at anchor 4 ("good keyword coverage; a few natural terms missing") rather than the comprehensive-synonym anchor. Not 3 because the present terms are natural, not generic filler.

4 / 5

Distinctiveness Conflict Risk

Clear niche with minimal conflict risk: the opening "CI-only self-healing workflow using gh-aw (GitHub Agentic Workflows) for active runtime recovery on pull requests and scheduled runs" carves out a distinct trigger surface, and it explicitly disambiguates from the closest sibling — "For interactive/local sessions, use `self-healing` instead" — and scopes the promotion consumer (`self-improvement-ci`). Not 4 because it does not merely reduce overlap; it actively redirects the conflicting case.

5 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 6 suspicious

Warning

Total

15

/

16

Passed

Repository

pskoett/pskoett-ai-skills

Path

plugin/skills/self-healing-ci/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.