CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

probe-merged-change

Run an exploratory quality pass over a change that has ALREADY merged in constructorfabric/insight — research the diff, smoke it on a stand carrying that exact build, then execute a test plan across the five quality vectors (Efficiency, Reliability, Performance, Security, Versatility) and hand each surviving finding to file-bug-insight. Use for "test what just merged", "exploratory pass on #N", "check this change across the quality vectors", "we shipped X, go break it", or a QA sweep of a release candidate's new feature. NOT for planning tests before implementation (scope-feature-tests), NOT for binding tests to a FEATURE's Definitions of Done (quality-vector-tests), NOT for validating a whole stand (insight-stand-validate), and NOT for confirming a known defect is fixed (verify-fix).

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, dense body: the workflow is explicitly sequenced with a smoke gate, a reproduce-on-healthy-stand classification loop, and filing triage — workflow clarity is exemplary. The deductions are minor: a few stylistic redundancies could be trimmed for token efficiency, the smoke checks and build pinning are described rather than given as runnable commands, and the single ~85-line file inlines worked examples that a leaner overview would offload.

Suggestions

Give the three smoke checks as the actual three runnable commands (or name exactly where they live), and show the image-pinning/reuse-compose steps concretely, so the gate that decides whether to plan at all is copy-paste executable.

Cut the generalizing restatement after the three cap examples ("for any input the system narrows — truncates, rounds, coerces...") and a few stylistic flourishes; the concrete cases already carry the pattern.

Move the longer worked examples (the 65-row unreachable listing, the 4,000-character silent clip) into a small references file or compress each to a one-line exemplar so SKILL.md stays a lean overview with one-level-deep detail.

DimensionReasoningScore

Conciseness

The prose assumes competence throughout — no basic testing concepts are re-explained — and every section teaches a non-obvious heuristic (the "accepted, reported success, silently modified" third state, combination findings, the client/server field seam). It falls short of the score-5 lean anchor on stylistic redundancy: flourishes like "the same defect wearing different clothes" and the closing generalized restatement ("for any input the system narrows — truncates, rounds, coerces...") restate a pattern the three preceding cap examples already established. It is well above the score-3 anchor because there is no unnecessary explanation, only minor trimmable padding.

4 / 5

Actionability

The probes are concrete and executable in substance — "send a value far past it and then read the record back", "Capture one real request body from the interface, then compare its keys against the request type in the published OpenAPI and against the stored columns", "playwright-cli route" for hostile input. It stops short of the score-5 anchor because the smoke gate names "three commands" but only describes the three checks (migration applied, round trip, gated read) without the runnable commands, and "Pin the images to the build tag from the release commit" is direction rather than a concrete command; it is well above score-3 because the guidance is genuinely specific, not pseudocode.

4 / 5

Workflow Clarity

The body opens with an explicit five-step sequence (Research → Smoke → Plan → Execute → File) and backs it with real validation and recovery: "If any of those fails, stop — but classify before you file. Re-run the failed check on a stand you have confirmed healthy and seeded... What reproduces there is the report; what does not is layer: stand" is an explicit validate-classify-retry feedback loop, and "Expect a mass write to a shared stand to be refused" anticipates failure of the riskiest operation. The "What not to file" section adds a final triage checkpoint, matching the score-5 anchor for explicit validation steps, error-recovery loops, and checklists.

5 / 5

Progressive Disclosure

Structure is good: clearly headed sections and well-signaled delegation to sibling skills ("Take vector semantics from quality-vector-tests/references/vector-mapping.md rather than re-deriving them") that is one level deep. It does not reach the score-5 anchor because at ~85 lines with no bundle of its own, all worked examples (the 65-row listing, the 4,000-character clip) are inlined in SKILL.md rather than split out; it stays above score-3 because the organization and cross-references are clear, not buried.

4 / 5

Total

17

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A model description: it states exactly what the skill does, quotes five natural trigger phrases a user would actually say, and explicitly excludes four named sibling skills so it will not fire for the wrong one. Both the what and the when are concrete and complete, in third-person imperative voice with no fluff.

DimensionReasoningScore

Specificity

The description enumerates the full workflow concretely: "research the diff, smoke it on a stand carrying that exact build, then execute a test plan across the five quality vectors (Efficiency, Reliability, Performance, Security, Versatility) and hand each surviving finding to file-bug-insight". This matches the anchor for multiple specific concrete actions with comprehensive coverage; it does not fit the score-4 anchor because there are no minor gaps — every phase of the pass is named.

5 / 5

Completeness

Both questions are answered explicitly: the "what" is the research/smoke/execute/file workflow across the five vectors, and the "when" is a literal "Use for" clause with concrete trigger phrases. It also exceeds the score-4 anchor by adding explicit negative scope ("NOT for planning tests before implementation", etc.), leaving no ambiguity about when to invoke it.

5 / 5

Trigger Term Quality

Five quoted natural trigger phrases — "test what just merged", "exploratory pass on #N", "check this change across the quality vectors", "we shipped X, go break it", "a QA sweep of a release candidate's new feature" — cover the varied ways a user would actually phrase the request, including casual ("go break it") and issue-number ("#N") variants. This matches the comprehensive-synonyms anchor rather than the score-4 anchor, where a few natural terms would be missing.

5 / 5

Distinctiveness Conflict Risk

Four "NOT for" clauses each name the competing sibling skill — "(scope-feature-tests)", "(quality-vector-tests)", "(insight-stand-validate)", "(verify-fix)" — which is exactly the clear-niche, minimal-conflict pattern of the score-5 anchor. It cannot be the score-4 anchor because the overlap risk with the nearest neighbors is explicitly resolved rather than merely minor.

5 / 5

Total

20

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

Total

15

/

16

Passed

Repository

constructorfabric/insight

Path

.claude/skills/probe-merged-change/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.