CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/feature-flag-test-harness

Use when a feature behind a flag must be tested both on and off, or several flags interact. Runs the same suite under the minimum set of flag combinations with an OpenFeature in-memory provider, as labeled CI matrix shards, and reports results per combination.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured skill body: lean, concrete, and disciplined about progressive disclosure, with a complete worked example that shows the actual shard count and failure output. The main improvement areas are tightening the repeated 2^N messaging and making the aggregation/verification steps as executable as the provider wiring.

Suggestions

State the 'minimum cover, not the full 2^N product' principle once (Step 1) and cut the repetitions in the Overview and How-to-use lists.

Inline a minimal JUnit-XML aggregation command or output snippet so step 6 is as executable as the provider wiring, keeping the full script in references/matrix-and-ci.md.

Add an explicit validation checkpoint, e.g. 'verify each shard booted with FLAGS_JSON and none contacted the production flag service', to close the workflow's feedback loop.

DimensionReasoningScore

Conciseness

The body is efficient and assumes competence (no explanation of what flags or CI are), but the 'never the full 2^N product' point is repeated three times (Overview item 2, How-to-use step 2, and Step 1), and the Overview's determinism rationale is mildly motivational. This is anchor 4 — minor trimming possible — rather than the every-token-earns-its-place lean of a 5.

4 / 5

Actionability

Concrete, executable guidance dominates: a complete flag-matrix.yaml schema, runnable TypeScript provider wiring, the real command 'python scripts/gen-flag-matrix.py tests/flag-matrix.yaml', and a worked example with exact shard counts (9 + 4 = 13). Minor gaps keep it at anchor 4: the aggregation step has no inline code, and the gen-flag-matrix.py script must be sourced from a reference file rather than existing as a bundle script.

4 / 5

Workflow Clarity

The 'How to use' section gives a clearly sequenced 7-step process, and 'fail-fast: false' plus per-combination aggregation act as explicit checkpoints so every failure surfaces. It falls short of anchor 5 because there is no explicit error-recovery loop or verification step (e.g., confirming no shard touched the production flag service); the worked example demonstrates reading failures but only implicitly.

4 / 5

Progressive Disclosure

The SKILL.md is a genuine overview: multi-language wiring, CI matrix YAML, aggregation, and the anti-pattern table are all split into three clearly signaled, one-level-deep reference files that all exist in the bundle with no nested references. This matches anchor 5 — clear overview, well-signaled references, easy navigation.

5 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it pairs an explicit, concrete 'Use when' trigger clause with a specific third-person statement of what the skill does, covering the full pipeline from provider swap to per-combination reporting. The only weakness is trigger synonym coverage — 'feature toggle' and common vendor names would catch more natural phrasings.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions covering the whole pipeline: 'Runs the same suite under the minimum set of flag combinations', 'with an OpenFeature in-memory provider', 'as labeled CI matrix shards', and 'reports results per combination'. Coverage is comprehensive with no significant gaps, matching the anchor for multiple specific concrete actions rather than the 'minor gaps' of a 4.

5 / 5

Completeness

It explicitly answers 'when' with a concrete 'Use when' clause ('must be tested both on and off, or several flags interact') and 'what' with specific third-person actions (in-memory provider, minimum combination set, CI matrix shards, per-combination reporting). Both are explicit and concrete, matching anchor 5; a 4 would require the 'when' to be less specific.

5 / 5

Trigger Term Quality

Natural phrases a user would say are present ('a feature behind a flag must be tested both on and off', 'several flags interact'), but common synonyms like 'feature toggle', 'release toggle', or vendor names (LaunchDarkly, Flagsmith) are absent from the description. This is good keyword coverage with a few natural terms missing — the anchor for 4 — rather than the comprehensive synonym coverage of a 5.

4 / 5

Distinctiveness Conflict Risk

The flag-combination test harness niche is distinct with dedicated triggers (testing flags on/off, interacting flags) that no general testing or CI skill would claim. Minimal conflict risk, matching anchor 5; the minor overlap with generic CI-matrix skills does not rise to the 'minor overlap risk' language of a 4.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

15

/

16

Passed

Reviewed

On this page