CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

test-release

Verify a released archon binary works end-to-end via a specific install path. Use when: cutting a new release, reproducing a user bug report on the released version, or validating that a hotfix binary actually works after a re-tag. Triggers: "test the release", "test 0.3.1 via brew", "verify the curl install", "smoke test the binary", "did the release binary work", "run /test-release", "verify the release". NOT for: testing dev work (use bun link directly), testing unreleased changes (build locally via scripts/build-binaries.sh first), or running the full validate suite (bun run validate is separate).

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An excellent operational runbook: fully executable commands, rigorously sequenced phases with validation and feedback loops, and hard-won failure diagnostics for each test. The skill's length is mostly earned, but repeated dev-binary assurances, long historical asides, and inline example reports keep conciseness and progressive disclosure at 4 rather than 5.

Suggestions

Trim the repeated "dev binary untouched" messaging to a single statement (e.g., keep the Phase 2 capture and the Key behaviors bullet) and cut the intro/Phase 5 restatements.

Move the two full example reports and the "History — do not re-assert the old criteria" / env-var-pipe-gotcha asides into a references/ file (e.g., references/report-templates.md and references/known-failures.md), keeping only one-line pointers in the body.

Relocate version-sensitive notes ("From 0.12.0…", "the 0.7.1 test") into a clearly labeled history/old-patterns section so they don't blur the current procedure.

DimensionReasoningScore

Conciseness

The body is dense and operational — commands, pass criteria, and failure catalogs with almost no explanation of concepts Claude already knows — but a few passages could be trimmed: the "dev binary untouched" point is made in the intro, Phase 2, Phase 5, and Key behaviors, and the history blockquotes (env-var pipe gotcha, "do not re-assert the old criteria") are longer than needed. Version-sensitive references ("From 0.12.0…", "the 0.7.1 test") sit outside any old-patterns section. Fits anchor 4 (minor over-explanation) rather than 5, and is clearly above 3.

4 / 5

Actionability

Every phase has copy-paste-ready commands: per-path install snippets, an exact executable assertion script for the env-leak test with symlink resolution (resolved_repo=$(cd "$LEAKREPO" && pwd -P)), exit-code capture, and cleanup commands including the archon-stable restore branch. Matches the anchor-5 example of fully executable guidance covering the common cases.

5 / 5

Workflow Clarity

Six clearly sequenced phases with explicit validation checkpoints throughout: pre-flight prerequisite and release-existence checks, a confirmation gate before install, per-test pass criteria, continue-on-failure with a FAIL verdict, guaranteed Phase 5 cleanup, and "Common failures" sections giving error-recovery feedback loops. Matches the anchor-5 example; the destructive-operation cap does not apply because validation is explicit.

5 / 5

Progressive Disclosure

No bundle files exist, so all content is inline in a single well-sectioned SKILL.md with clear phase headers, a Related section pointing at real repo paths, and easy linear navigation — appropriate for a sequential procedure. Minor gaps: the ~90 lines of example PASS/FAIL reports and the historical-criteria notes could live in a references file, leaving the body leaner. Fits anchor 4 (good structure, minor organization gaps) rather than 3, whose example is noticeably worse organized.

4 / 5

Total

18

/

20

Passed

Description

91%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: precise what, explicit use-when with concrete trigger phrases, and a NOT-for boundary clause. The only weaknesses are the minor overlap of the "cutting a new release" trigger with the release-procedure skill and the install paths not being enumerated inline.

DimensionReasoningScore

Specificity

"Verify a released archon binary works end-to-end via a specific install path" names the domain and a precise concrete action, with the NOT-for clause bounding scope; only the enumeration of the three install paths is left to the body, a minor coverage gap. Fits anchor 4 better than 3 because the 'what' is exact rather than a generic 1-2 action listing.

4 / 5

Completeness

Explicitly answers what ("Verify a released archon binary works end-to-end via a specific install path") and when ("Use when: cutting a new release, reproducing a user bug report on the released version, or validating that a hotfix binary actually works after a re-tag"), with concrete trigger phrases and a NOT-for clause. Matches the anchor-5 example structure exactly.

5 / 5

Trigger Term Quality

Triggers list natural phrases with synonyms and variations — "test the release", "smoke test the binary", "did the release binary work", "verify the curl install", "run /test-release" — plus a version-parameterized example ("test 0.3.1 via brew"). Coverage is comprehensive for this domain with no obvious missing terms.

5 / 5

Distinctiveness Conflict Risk

The released-binary smoke-test niche is distinct and the NOT-for clause cleanly separates dev testing and the validate suite, but "Use when: cutting a new release" slightly overlaps the /release procedure skill the body references — minor overlap risk with a closely related skill, so anchor 4 rather than 5.

4 / 5

Total

18

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (545 lines); consider splitting into references/ and linking

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

referenced_paths_exist

Referenced path issues: 8 missing

Warning

Total

13

/

16

Passed

Repository

coleam00/Archon

Path

.claude/skills/test-release/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.