CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

quality-vector-tests

Bind Insight tests to the requirements they prove, the canonical Studio way: a FEATURE's Definitions of Done are what tests verify, a test names the DoD or flow ID it proves, and quality vectors stay on the PRD's NFRs. Use when choosing the suite for a check, linking a test to its FEATURE, checking a DoD item off, or reviewing whether a feature's requirements are proven.

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality, densely written instruction body: an unambiguous five-step workflow, a concrete suite-selection table, executable validation commands, and well-split bundle files. The remaining gaps are a missing error-recovery loop after validation, a few trimmable rationale sentences, and out-of-bundle guide links that break the one-level-deep navigation.

Suggestions

After the `cfs validate` commands, add one explicit recovery line (e.g. 'If validation fails: fix the artifact or TOC entry and re-run all three before checking any DoD item') to close the workflow's feedback loop.

Trim the parenthetical justifications Claude can infer — e.g. why a real-traffic percentile beats a synthetic run — and let scripts/counts.sh's own header carry the MOVED rationale instead of restating it in the body.

Copy the essential vector definitions (or a summary table) into references/ and keep the `../../../.cf-studio/...` guide link only as a provenance note, so navigation from SKILL.md stays one level deep and fully within the bundle.

DimensionReasoningScore

Conciseness

The body is lean and assumes competence — it never explains what pytest, vitest, dbt or CI is, and nearly every sentence is an instruction or a rule. A few rationale sentences could be trimmed (e.g. "a synthetic run at an invented scale is weaker evidence than a percentile from real use", and restating counts.sh's MOVED rationale in the body when the script's header already documents it), which keeps it at anchor 4's 'minor instances that could be trimmed' rather than anchor 5's every-token-earns-its-place. It is far above anchor 3, which requires actual unnecessary explanation.

4 / 5

Actionability

Guidance is fully executable: a suite-selection table with concrete suite tags and directory paths, the exact `-m` marker mechanism, a literal docstring example (`Verifies cpt-ir-dod-manual-resolution-idempotency`), instructions to take counts from `scripts/counts.sh` rather than quote them, and copy-paste `cfs validate` commands. This matches anchor 5: specific, ready-to-run commands covering the common cases.

5 / 5

Workflow Clarity

Five clearly sequenced sections (resolve → ground → choose suite → link → validate) end in explicit validation commands plus a two-direction chain-review checklist ('each DoD item has a test naming it, or an open decision with an owner'). What is missing is an explicit error-recovery loop — what to do when `cfs validate` or `validate-toc` fails — which keeps it at anchor 4 ('most checkpoints present; minor validation gaps') rather than anchor 5's feedback loops.

4 / 5

Progressive Disclosure

Against the actual bundle: the vector taxonomy is correctly split into references/vector-mapping.md and the counting denominators into scripts/counts.sh, both real files, clearly signaled and one level deep, with the body keeping only the overview-level rules. The gap is that two links point out-of-bundle to `../../../.cf-studio/config/kits/sdlc/guides/quality-vectors.md`, an unverifiable external path that adds a second hop for the definitions — anchor 4's 'minor organization gaps' rather than anchor 5's clean one-level-deep navigation.

4 / 5

Total

17

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it states concretely what the skill does and gives an explicit, multi-trigger 'Use when' clause in third person. Its main weaknesses are jargon-dense phrasing that partly obscures the actions and a few missing natural synonyms (test plan, coverage, traceability) that would broaden trigger recall.

Suggestions

Split the single chain-style opening sentence so each concrete action ('name the DoD or flow ID in the test', 'keep quality vectors on the PRD NFRs') stands on its own rather than being compressed into one jargon-heavy clause.

Add one or two natural variations to the 'Use when' clause — e.g. 'writing or planning tests for a feature' or 'reviewing test coverage or traceability of a FEATURE' — so users who phrase the need differently still match.

DimensionReasoningScore

Specificity

The description lists several concrete actions — "Bind Insight tests to the requirements they prove", "a test names the DoD or flow ID it proves", "quality vectors stay on the PRD's NFRs" — but they are wrapped in dense internal jargon (DoD, FEATURE, PRD NFRs, 'canonical Studio way') that slightly obscures the concrete action, and the chain-style framing is partly abstract. This sits above anchor 3 (only 1-2 actions) but below anchor 5, whose actions are plainly concrete without a jargon barrier.

4 / 5

Completeness

It explicitly answers both questions: the 'what' is stated concretely (tests bind to the DoD or flow ID they prove, vectors stay on PRD NFRs) and the 'when' is an explicit 'Use when' clause with four concrete trigger scenarios. This matches anchor 5 (clear 'what' AND 'when' with concrete trigger phrases), not anchor 4 where the 'when' is only weakly specific.

5 / 5

Trigger Term Quality

The 'Use when' clause carries natural workflow phrases — "choosing the suite for a check", "linking a test to its FEATURE", "checking a DoD item off", "reviewing whether a feature's requirements are proven" — that a user in this workflow would plausibly say. It misses common variations a user might utter ("write tests for a feature", "test plan", "coverage", "traceability"), so it does not reach anchor 5's comprehensive synonym coverage, but is clearly above anchor 3's partial keyword set.

4 / 5

Distinctiveness Conflict Risk

It carves a clear niche — Studio/Insight test-to-requirement binding — with distinct triggers (DoD items, FEATURE linking, quality vectors) unlikely to fire for unrelated skills. However, "choosing the suite for a check" and "reviewing whether a feature's requirements are proven" could overlap with a generic test-writing or test-review skill, so anchor 4's 'minor overlap risk with closely related skills' fits better than anchor 5's minimal conflict risk.

4 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 1 suspicious

Warning

Total

15

/

16

Passed

Repository

constructorfabric/insight

Path

.claude/skills/quality-vector-tests/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.