CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/regression-suite-selector

Builds a CI workflow that runs only the subset of tests impacted by a PR's changes - combines a per-test → source-file dependency map (built from coverage profiles or, in build-graph projects, queried from the build system itself like Bazel `rdeps`) with the PR's `git diff --name-only`, then selects the union of (impacted by changed files + previously failing + newly added). Always pairs with a periodic full-suite run so a misconfigured map can't silently shrink coverage. Use when the regression suite is large enough that PR-time CI is the bottleneck and a full run is reserved for nightly / pre-release.

69

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Overview
Quality
Evals
Security
Files

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, actionable recipe with copy-paste code and a clean one-level reference split. It could be tightened slightly and its safety validation made more like an inline gate rather than a retrospective net.

Suggestions

Trim the Overview/Azure-comparison framing to the minimum needed to justify the fallback rule; assume TIA familiarity and let the References carry background.

Promote the Step 5 shadow-run comparison into an explicit validate-then-proceed checkpoint (e.g., 'if T2 != T1, fail the PR run and update the map before merging') to close the inline-validation gap.

Inline a minimal CI workflow YAML skeleton (selected + shadow job) so the core path is executable without opening the reference, keeping per-framework instrumentation external.

DimensionReasoningScore

Conciseness

Dense and mostly efficient with no basic-concept padding; the Overview and Azure-comparison paragraphs add slightly more conceptual framing than pure instruction, so it stops just short of fully lean.

4 / 5

Actionability

`build_map`, `select_tests`, the three-dot `git diff`, and the PR-comment template are copy-paste ready; the full CI workflow YAML and per-framework instrumentation are correctly referenced out, leaving minor inline gaps.

4 / 5

Workflow Clarity

Steps 1–7 are clearly sequenced with a Step 5 drift-detection feedback loop and an Anti-patterns checklist, but validation is safety-net style (nightly/shadow run) rather than an inline validate-then-proceed gate.

4 / 5

Progressive Disclosure

Clear overview with one real, clearly-signaled reference (references/instrumentation-and-ci.md, verified present) one level deep; core selector stays inline while per-framework recipes and CI YAML are split out.

5 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A highly specific, third-person description that explicitly covers both capability and trigger conditions with concrete user-facing phrasing. Only minor trigger-synonym coverage is missing.

DimensionReasoningScore

Specificity

Lists multiple concrete, comprehensively-stated actions in third person ('Builds a CI workflow that runs only the subset of tests impacted', 'combines a per-test → source-file dependency map', 'selects the union of (impacted + previously failing + newly added)', 'pairs with a periodic full-suite run').

5 / 5

Completeness

Explicitly answers both 'what' (the selector mechanics) and 'when' via a concrete 'Use when the regression suite is large enough that PR-time CI is the bottleneck...' trigger clause.

5 / 5

Trigger Term Quality

Strong natural user phrasing ('regression suite', 'PR-time CI is the bottleneck', 'full-suite run', 'nightly / pre-release', 'git diff'), but a few natural synonyms like 'test selection' or 'test impact analysis' are absent.

4 / 5

Distinctiveness Conflict Risk

Occupies a clear, specific niche (PR-time test impact analysis / regression-suite selection) with distinct triggers and minimal overlap risk against adjacent qa skills.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

15

/

16

Passed

Reviewed

Table of Contents