CtrlK
BlogDocsLog inGet started
Tessl Logo

smoke-check

Critical-path smoke gate before QA hand-off — runs the automated suite. A failed check means the build is not QA-ready.

53

Quality

67%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./.claude/skills/smoke-check/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

70%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is an exceptionally actionable and rigorously sequenced gate skill — concrete commands, exhaustive exit-code semantics, and validation at every phase — undermined by verbosity and zero progressive disclosure. A 750-line single file inlines per-engine material that belongs in separate reference files, and repeats both instructions and design-rationale commentary that add tokens without adding instruction.

Suggestions

Move the per-engine runner instructions (Phase 2's Godot, Unity, and Unreal sections, ~200 lines) into separate reference files such as references/godot-runner.md, references/unity-runner.md, references/unreal-runner.md, keeping only the engine-selection dispatch and verdict-relevant exit codes in SKILL.md.

Replace the six verbatim repetitions of 'For any selected item, ask the user to briefly describe what failed before generating the report' with a single rule stated once before the batch definitions.

Cut or compress the design-rationale blockquotes ('A bare halt is the wrong shape here…', the NOT ASSESSED ranking defense, 'This is a change… and it is deliberate') into one-line statements of the rule — the reasoning essays are commentary, not instruction, and cost significant tokens.

DimensionReasoningScore

Conciseness

The body is noticeably verbose across several padded sections: the instruction 'For any selected item, ask the user to briefly describe what failed before generating the report' is repeated verbatim ~6 times across Batch 1/2/3 and the platform batches, and multi-line blockquote essays ('A bare halt is the wrong shape here…', the NOT ASSESSED ranking defense, 'This is a change in where unconfirmed NOT RUN lands, and it is deliberate') are design-rationale commentary rather than instructions. It is above level 1 because the engine-specific exit codes, timeouts, and gotchas are genuinely non-obvious knowledge Claude does not already have; it is below level 3 because the repetition and rationale-padding are substantial and easily trimmed.

2 / 5

Actionability

Guidance is fully executable: exact copy-paste bash commands with timeout wrappers for all three engines and all three OSes, per-engine exit-code-to-verdict mappings (e.g. gdUnit4 0/101/100/105/103/104/1), concrete resolution rules for placeholders ('$(pwd -W 2>/dev/null || pwd) gives the C:/… form in Git Bash'), explicit AskUserQuestion batch definitions, and a complete report template. The common cases (Godot, Unity EditMode+PlayMode, Unreal) are each covered with runnable commands, matching the top anchor; it is not level 4 because no significant execution gap was found.

5 / 5

Workflow Clarity

Six phases are clearly sequenced (detect setup → run tests → coverage → manual checks → report → gate) with explicit validation checkpoints at every phase: exit-code interpretation rules, 'a timeout (exit 124) is a gate FAILURE, never a pass', deletion of stale results files before runs, a first-matching-rule-wins verdict table, and write-only-after-approval gating. Error-recovery feedback loops ('fix the failures and run /smoke-check again') are explicit, matching the top anchor; it is not level 4 because checkpoints are present with no material gaps.

5 / 5

Progressive Disclosure

The file has clear, navigable phase headers, so structure is not minimal — but ~200 lines of per-engine runner instructions (Phase 2's Godot/Unity/Unreal sections) and the long report template are inlined in a 750-line monolithic SKILL.md with no references/ bundle at all, matching the 'some structure but… content that should be separate is inline' anchor. It is above level 2 (headers make it navigable, and external doc references are named, e.g. docs/engine-reference/unreal/current-best-practices.md) but below level 4 because content that clearly belongs in per-engine reference files sits inline.

3 / 5

Total

15

/

20

Passed

Description

53%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is tight, specific to its niche, and states a clear gate outcome, but it undersells the skill's full capability set and lacks any explicit 'Use when…' trigger guidance. Natural trigger phrasings like 'smoke test' and 'test suite' are absent, weakening both completeness and retrieval.

Suggestions

Add an explicit trigger clause, e.g. 'Use when the user asks for a smoke test, wants to verify the build before QA hand-off, or mentions QA readiness' — this addresses the completeness cap and improves trigger matching.

Expand the capability list to match the body's actual actions: 'runs the automated test suite, checks test-coverage gaps, batch-verifies critical paths, and produces a PASS/FAIL gate report' instead of only 'runs the automated suite'.

Include natural synonyms users would say — 'smoke test', 'test suite', 'pre-QA check' — so the skill surfaces for those phrasings, not just 'smoke gate'.

DimensionReasoningScore

Specificity

The description names a specific domain ("Critical-path smoke gate before QA hand-off") and one concrete action ("runs the automated suite"), but omits the skill's other capabilities documented in the body (coverage gap scan, batch verification of critical paths, PASS/FAIL report) — matching the 'names domain and 1-2 concrete actions, but not comprehensive' anchor. It is above level 2 because the action and domain are concrete, and below level 4 because only one action is listed.

3 / 5

Completeness

The 'what' is clear (runs the automated suite as a pre-QA gate), but there is no explicit 'Use when…' clause or equivalent trigger guidance — timing is only weakly implied by "before QA hand-off", which caps completeness at 3 per the judging guidelines. Not level 4: the when-phrase is positional, not an explicit trigger phrase for user situations.

3 / 5

Trigger Term Quality

Relevant domain keywords are present ("smoke gate", "QA hand-off", "automated suite", "build", "QA-ready") but common natural variations users would actually say — "smoke test", "test suite", "run the tests" — are missing, matching the 'some relevant keywords but missing common variations or synonyms' anchor. Better than level 2 (several domain-specific, natural-ish terms exist) but short of level 4's 'good keyword coverage'.

3 / 5

Distinctiveness Conflict Risk

The description carves a clear niche (pre-QA-hand-off smoke gate with a blocking outcome: "A failed check means the build is not QA-ready") that is mostly distinct from generic run-the-tests skills, with only minor overlap risk against a plain test-runner skill. Not level 5: without explicit trigger phrases, a user asking to 'run the tests' could plausibly match a generic testing skill instead.

4 / 5

Total

13

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (764 lines); consider splitting into references/ and linking

Warning

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

13

/

16

Passed

Repository
Donchitos/Claude-Code-Game-Studios
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.