CtrlK
BlogDocsLog inGet started
Tessl Logo

test-release-canary

Manually dispatch and iterate on the Release Canary workflow that smoke-tests published OpenShell artifacts (install.sh on macOS/Ubuntu/Fedora, Helm chart on kind) after each Release Dev publish. Use when changing `.github/workflows/release-canary.yml`, validating a release before tagging, debugging a canary failure, or reproducing a canary job locally. Trigger keywords - release canary, release-canary, canary failed, canary dispatch, test release canary, post-release smoke, install.sh canary, helm chart canary, kind canary, dispatch canary.

80

Quality

100%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Medium

Suggest reviewing before use

SKILL.md
Quality
Evals
Security

Quality

Content

100%Weight 40%Scale 1-3

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a dense but well-structured operational runbook with executable commands, explicit validation steps, and clear diagnostic guidance. It efficiently transfers repo-specific knowledge Claude would not otherwise have.

DimensionReasoningScore

Conciseness

The body assumes Claude's competence and avoids explaining known concepts, with every section earning its place; the only minor redundancy is overlap between 'Manual dispatch' and 'Iterating on the canary itself', but it stays lean rather than the score-2 'could be tightened' case.

3 / 3

Actionability

Fully executable, copy-paste-ready commands are given throughout — `gh workflow run release-canary.yml --ref …`, `helm install openshell oci://… --version 0.0.0-dev --wait --timeout 5m`, `kubectl wait … --for=condition=Ready` — rather than pseudocode or vague direction.

3 / 3

Workflow Clarity

Multi-step processes are clearly sequenced with explicit validation checkpoints (`--wait --timeout`, `kubectl wait --for=condition=Ready pod --timeout=300s`) and a feedback/recovery loop via the failure-diagnostics table, matching the score-3 anchor instead of the checkpoint-missing score-2 form.

3 / 3

Progressive Disclosure

Content is organized into clear, single-level sections with well-signaled cross-references to sibling skills (helm-dev-environment, watch-github-actions, debug-openshell-cluster) and precise in-repo file:line pointers, with no deeply nested reference chains that would cap it at score 2.

3 / 3

Total

12

/

12

Passed

Description

100%Weight 40%Scale 1-3

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concrete, third-person, and fully covers both capability and trigger conditions with natural keywords, scoring at the top of every dimension. It is well within the bounds of accurate, non-padded communication.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'Manually dispatch and iterate on the Release Canary workflow that smoke-tests published OpenShell artifacts (install.sh on macOS/Ubuntu/Fedora, Helm chart on kind)' — matching the 'multiple specific concrete actions' anchor rather than the score-2 'names domain and some actions'.

3 / 3

Completeness

Explicitly answers both what (smoke-tests published artifacts after Release Dev) and when via a clear 'Use when changing `.github/workflows/release-canary.yml`, validating a release before tagging, debugging a canary failure, or reproducing a canary job locally' clause, rather than the score-2 implied-when form.

3 / 3

Trigger Term Quality

Provides a rich keyword list users would naturally say — 'release canary', 'canary failed', 'canary dispatch', 'post-release smoke', 'helm chart canary', 'kind canary' — covering common variations rather than the partial score-2 set.

3 / 3

Distinctiveness Conflict Risk

Occupies a clear niche — the Release Canary workflow specifically — with distinct triggers, making it unlikely to fire for unrelated skills; not the score-2 'somewhat specific but could overlap'.

3 / 3

Total

12

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
NVIDIA/OpenShell
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.