CtrlK
BlogDocsLog inGet started
Tessl Logo

test-release-canary

Manually dispatch and iterate on the Release Canary workflow that smoke-tests published OpenShell artifacts (install.sh on macOS/Ubuntu/Fedora, Helm chart on kind) after each Release Dev publish. Use when changing `.github/workflows/release-canary.yml`, validating a release before tagging, debugging a canary failure, or reproducing a canary job locally. Trigger keywords - release canary, release-canary, canary failed, canary dispatch, test release canary, post-release smoke, install.sh canary, helm chart canary, kind canary, dispatch canary.

76

Quality

94%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured, actionable runbook: executable commands, a verification matrix, trigger logic, local reproduction steps, and a diagnostics table with feedback loops. It assumes Claude's competence and avoids concept padding, with only minor editorializing that could be trimmed.

Suggestions

Tighten the explanatory prose in 'Iterating on the canary itself' and 'Testing artifacts from a specific SHA' to declarative statements; the editorializing ('This is what you want...') can be cut without losing the decision-relevant gotcha about latest-tagged vs dev artifacts.

Consider moving the full 'Local kind reproduction' command block into a bundled reproduce-kind.sh script referenced one level deep, keeping SKILL.md as an overview and improving progressive_disclosure.

DimensionReasoningScore

Conciseness

Dense and assumes Claude's competence (no primer on Helm/kind/GitHub Actions), with each section earning its place; a few editorializing sentences ("This is what you want for iterating on the canary — you're validating that the canary still works against known-good artifacts") could be trimmed, so it sits at 4 rather than 5.

4 / 5

Actionability

Copy-paste-ready commands throughout ("gh workflow run release-canary.yml --ref \"$(git branch --show-current)\"", the full helm install / kubectl wait / port-forward sequence) plus a concrete symptom→cause→location diagnostics table covering common cases.

5 / 5

Workflow Clarity

Sequences are explicit with validation checkpoints (job gates on `github.event.workflow_run.conclusion == 'success'`, `helm install --wait --timeout 5m`, `kubectl wait --for=condition=Ready ... --timeout=300s`) and a feedback loop via the failure-diagnostics section describing the ordered dump to read top-to-bottom.

5 / 5

Progressive Disclosure

Well-organized into clear navigable sections (What the canary verifies, Trigger paths, Manual dispatch, Local kind reproduction, Diagnosing failures, Related) with one-level-deep pointers to repo files and related skills; no bundle files exist to split further, so it is well-structured but does not exercise file-level progressive disclosure.

4 / 5

Total

18

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is exemplary: it states concrete capabilities, provides an explicit 'Use when' clause with multiple triggering scenarios, and lists a rich set of natural trigger keywords including hyphenated variants. It is tightly scoped to the Release Canary workflow with negligible overlap risk.

DimensionReasoningScore

Specificity

Lists multiple concrete actions ("Manually dispatch and iterate on the Release Canary workflow", "smoke-tests published OpenShell artifacts (install.sh on macOS/Ubuntu/Fedora, Helm chart on kind)") with comprehensive coverage of what is exercised; not below 5 since no concrete action class is omitted.

5 / 5

Completeness

Explicitly answers what (smoke-tests published OpenShell artifacts) and when ("Use when changing `.github/workflows/release-canary.yml`, validating a release before tagging, debugging a canary failure, or reproducing a canary job locally") with concrete trigger phrases.

5 / 5

Trigger Term Quality

Comprehensive keyword list covering natural phrases and synonym/variant forms ("release canary, release-canary, canary failed, canary dispatch, test release canary, post-release smoke, install.sh canary, helm chart canary, kind canary, dispatch canary"); both spaced and hyphenated variants are present.

5 / 5

Distinctiveness Conflict Risk

Clear niche (Release Canary post-publish smoke test for OpenShell) with distinct, workflow-specific triggers that would not fire for unrelated skills; minimal conflict risk.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
NVIDIA/OpenShell
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.