CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

test-release

Verify a released archon binary works end-to-end via a specific install path. Use when: cutting a new release, reproducing a user bug report on the released version, or validating that a hotfix binary actually works after a re-tag. Triggers: "test the release", "test 0.3.1 via brew", "verify the curl install", "smoke test the binary", "did the release binary work", "run /test-release", "verify the release". NOT for: testing dev work (use bun link directly), testing unreleased changes (build locally via scripts/build-binaries.sh first), or running the full validate suite (bun run validate is separate).

71

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary operational skill: fully executable commands, explicit pass criteria with observed failure modes and issue references, strong validation checkpoints, and cleanup/restore guarantees that respect the user's environment. Its only weaknesses are mild verbosity (the shell-semantics aside and dual full example reports) and the lack of any progressive-disclosure split in a long single file.

Suggestions

Trim the curl-mac blockquote to the project-specific gotcha (the confusing sudo terminal failure and issue #2436) and drop the general explanation of how VAR=x prefixes behave across a pipe, which Claude already knows.

Replace the two full-length PASS and FAIL example reports with one template plus a short 'FAIL adds: captured command/exit/output and next steps' note, cutting ~30 lines.

Consider moving the per-test 'Common failures' issue tables into a references/troubleshooting.md so the main procedure stays a lean execution path for green runs.

DimensionReasoningScore

Conciseness

The body is long (~530 lines) but almost entirely project-specific operational detail Claude could not know — pass criteria, issue-number regressions, observed failure modes, restore logic — so nearly every token earns its place. Minor trims exist: the blockquote teaching basic shell pipe env-var semantics ("In VAR=x cmd1 | cmd2 the assignment applies only to cmd1") could be compressed to the project-specific gotcha alone, and two full-length example reports could share one template. This fits 'Efficient; minor instances of over-explanation that could be trimmed'; a 5 would require the lean density of a bare command list, and a 3 would require noticeably padded sections.

4 / 5

Actionability

Every phase is copy-paste executable: exact commands per path (brew tap/install, curl | INSTALL_DIR=… bash, ssh wrappers), per-test pass criteria with exit-code and output assertions, and a fully scripted exact-match assertion for the env-leak test (grep -qxF against the resolved repo path). Matches 'Fully executable; copy-paste ready code or commands; specific examples cover the common cases'.

5 / 5

Workflow Clarity

Six clearly sequenced phases (scope → pre-flight → install → smoke tests → uninstall → report) with explicit validation checkpoints: user confirmation before install, prerequisite checks with abort messages, per-test pass criteria plus 'Common failures' remediation lists (feedback loops), capture-before/verify-after of the dev binary, mandatory cleanup even on failure, and archon-stable restore logic. This matches the anchor-5 example with validation and error-recovery loops; the destructive-operation cap does not apply because validation is extensive.

5 / 5

Progressive Disclosure

No bundle files exist and all content lives in one well-sectioned SKILL.md: numbered phase headers, per-path subsections, a Key behaviors summary, and a Related section pointing at real repo files (scripts/build-binaries.sh, .github/workflows/release.yml, homebrew/archon.rb, scripts/install.sh). Navigation is easy and the procedure reads coherently in execution order, but a ~530-line monolith with no references/ split (the two full example reports and the issue-number failure tables are candidates) leaves minor organization gaps — matching 'Good structure; most content is appropriately placed; minor organization gaps' rather than the clearly-split anchor-5 pattern.

4 / 5

Total

18

/

20

Passed

Description

90%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A well-crafted description: explicit what/when, rich natural trigger phrases, and a sharp NOT-for boundary that separates it from dev testing and the validate suite. The only soft spot is specificity — the capability statement is one action deep, without naming the install paths or the smoke-test nature of the work.

Suggestions

Name the concrete actions in the 'what' line — e.g. mention the three install paths (brew / curl install script / VPS) and the smoke-test suite, so the capability scope is as explicit as the triggers.

DimensionReasoningScore

Specificity

The description names its domain ("released archon binary") and one concrete action ("Verify a released archon binary works end-to-end via a specific install path"), but the 'what' remains a single action rather than several enumerated capabilities — it never mentions the install paths (brew/curl-mac/curl-vps) or the smoke-test suite. This matches the anchor 'Names domain and 1-2 concrete actions, but not comprehensive'; a 4 would require several distinct specific actions listed.

3 / 5

Completeness

It explicitly answers both 'what' ("Verify a released archon binary works end-to-end via a specific install path") and 'when' ("Use when: cutting a new release, reproducing a user bug report on the released version, or validating that a hotfix binary actually works after a re-tag"), with concrete trigger phrases plus an explicit NOT-for boundary. This is the anchor-5 example pattern.

5 / 5

Trigger Term Quality

Triggers are comprehensive and natural: "test the release", "test 0.3.1 via brew", "verify the curl install", "smoke test the binary", "did the release binary work", "run /test-release", "verify the release" — covering synonyms, a versioned example, and the slash-command name. Matches the anchor 'Comprehensive coverage of natural terms including synonyms and file extensions'.

5 / 5

Distinctiveness Conflict Risk

A clear niche (released-binary smoke testing) with distinct triggers, and the NOT-for clause explicitly fences off adjacent skills ("testing dev work (use bun link directly)", "running the full validate suite (bun run validate is separate)"). Minimal conflict risk, matching the anchor-5 example.

5 / 5

Total

18

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (543 lines); consider splitting into references/ and linking

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

referenced_paths_exist

Referenced path issues: 8 missing

Warning

Total

13

/

16

Passed

Repository

coleam00/Archon

Path

.claude/skills/test-release/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.