CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

release-sample-sweep

Run the pre-release end-to-end sweep of every user-facing surface — the 33 samples under samples/ (booted from their packaged artifacts and driven in a real browser via chrome-devtools MCP), the Expo/React Native client, and the atmosphere CLI. Use before cutting a release, and after any change to the Console bundle, a shared module, atmosphere.js, the CLI, or several samples at once. Covers preconditions, the keyless Ollama backend, the per-sample launch/drive/collect/teardown loop, the evidence ledger, the fix phase (every issue gets a biting regression test in the right suite), the re-test subset, and the report.

76

Quality

96%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A tightly engineered operational skill: fully executable commands, a clearly sequenced 0–5 workflow rich in validation checkpoints and feedback loops, and exemplary one-level-deep reference structure with a closing file index. The only weakness is minor narrative padding in the safety rules and the historical-bug rationale that could be compressed without losing information.

Suggestions

Compress the Wi-Fi/network warning in non-negotiable #5 to a single line (e.g., "Never touch host network/VPN/DNS settings — a mid-toggle interruption can leave the machine offline") and drop the explanatory sentences about the maintainer's sessions.

Reduce the 'What it catches that CI does not' table to one summary line plus the two bug IDs, or move the full anecdotes into references/troubleshooting.md, keeping only the actionable rule (boot packaged artifacts, never dev mode) inline.

The parallel-lanes paragraph in Step 1a mixes port policy with WebTransport UDP details; move the UDP/`-Datmosphere.web-transport.port` mechanics into references/sample-matrix.md or troubleshooting.md and keep only the lane-isolation rule inline.

DimensionReasoningScore

Conciseness

The body is largely operational and project-specific (ports, env-scrub rules, boot commands) with no explanation of concepts Claude already knows. However, a few stretches are rationale/narrative rather than instruction — e.g., "The host's Wi-Fi carries every session the maintainer has open, and a sweep interrupted mid-toggle can leave the machine offline indefinitely" and the two-row historical-bug table with its "Why CI was green" column — which could be trimmed to one line each. That matches anchor 4 ("minor instances of over-explanation that could be trimmed"), not 5 ("every token earns its place") and not 3 (no generic-library padding anywhere).

4 / 5

Actionability

Guidance is copy-paste executable throughout: the exact launch command ".claude/skills/release-sample-sweep/scripts/sweep-sample.sh start <sample> --port <9101+n> --ready-path <path> --env LLM_MODE=local --env LLM_MODEL=qwen2.5:3b", precondition commands ("./mvnw install -DskipTests -Pfastinstall", "grep 'AI config:' target/sweep/<sample>-<port>.log"), evidence-collection calls ("list_console_messages", "sweep-sample.sh warnings <sample>"), and concrete verdict criteria per outcome. Deep per-surface detail is properly delegated to named reference files rather than left vague.

5 / 5

Workflow Clarity

Steps 0–5 are explicitly sequenced with a verification at nearly every checkpoint despite this being a large batch operation: "git status --porcelain # must be clean", the launcher refusing to boot on an occupied port, "Record each row as you finish that sample, never in a batch at the end", the helper verifying the port is actually released, regression specs "proven to bite: it must fail against the pre-fix artifact and pass after", and the explicit feedback loop "Repeat triage → fix → re-test until the sweep is clean". Validation is abundant, so the batch-operation cap of 3 does not apply; this matches the anchor-5 example with explicit validation and error-recovery loops.

5 / 5

Progressive Disclosure

The SKILL.md body is the orchestration procedure, while all per-surface depth is one level deep in well-signaled, existing files — "references/sample-matrix.md", "driving-recipes.md", "expo-sweep.md", "cli-sweep.md", "regression-specs.md", "retest-subset.md", "troubleshooting.md", plus "assets/ledger-template.md" and "scripts/sweep-sample.sh", all verified present. A closing "Files in this skill" table maps each file to its use, and every inline mention names its purpose. Navigation is easy and nothing is nested two-plus levels.

5 / 5

Total

19

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is a model example: concrete actions for all three surfaces, an explicit and multi-condition 'Use when' trigger clause, and a distinct niche with named modules and paths. It is dense but every clause is informative rather than padded, and it stays in third-person imperative voice.

DimensionReasoningScore

Specificity

The description enumerates multiple concrete, specific actions: "Run the pre-release end-to-end sweep of every user-facing surface", "booted from their packaged artifacts and driven in a real browser via chrome-devtools MCP", "the per-sample launch/drive/collect/teardown loop", "the fix phase (every issue gets a biting regression test in the right suite)", "the re-test subset, and the report". It names all three surfaces (samples, Expo client, CLI) and each sweep phase, giving comprehensive coverage with no generic filler.

5 / 5

Completeness

It explicitly answers both questions: what — "Run the pre-release end-to-end sweep of every user-facing surface — the 33 samples... the Expo/React Native client, and the atmosphere CLI", followed by the phase list ("preconditions... report"); and when — the explicit "Use before cutting a release, and after any change to..." clause with concrete trigger conditions. This matches the anchor-5 example structure (what + explicit 'Use when' with concrete triggers), not 4, because the 'when' clause is fully explicit rather than merely present.

5 / 5

Trigger Term Quality

Natural trigger phrases are present and specific: "Use before cutting a release, and after any change to the Console bundle, a shared module, atmosphere.js, the CLI, or several samples at once" — exactly what a maintainer would say. Concrete file/path terms ("samples/", "atmosphere.js", "Expo/React Native client", "chrome-devtools MCP") match how users refer to these surfaces. It does not reach merely 4 because no commonly used variation of the trigger scenario is missing.

5 / 5

Distinctiveness Conflict Risk

It occupies a clear niche (pre-release sweep of a specific 33-sample repo, its Expo client, and the atmosphere CLI) with distinct triggers tied to named modules ("Console bundle", "modules/cpr"-style shared modules, "atmosphere.js"). No other plausible skill would claim these triggers, so conflict risk is minimal — anchor 5, not 4, since even closely related skills (CI, code review) are explicitly differentiated by the packaged-artifact/browser framing.

5 / 5

Total

20

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

15

/

16

Passed

Repository

Atmosphere/atmosphere

Path

.claude/skills/release-sample-sweep/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.