CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

conformance-loop

Iteratively improve Fallow analysis accuracy by comparing it with competing tools and verified source truth across a stable real-world corpus.

Quality

78%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./.claude/skills/conformance-loop/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is an exemplar of lean, high-signal skill writing: a tightly sequenced conformance loop with explicit verification, adjudication persistence, and a net-improvement feedback gate, plus project-specific rationale that Claude could not infer. The only meaningful gap is that a few artifacts (adjudications.json record shape, the 'review' step) are underspecified for a reader new to the project.

Suggestions

Add a minimal example of one adjudications.json record (tool, finding, verdict, source-of-truth reference) so step 5 is copy-paste executable rather than inferable.

Briefly gloss 'Run `review`' (e.g. which command or CI lane it refers to) so the final step is actionable outside the project's original context.

DimensionReasoningScore

Conciseness

Every line carries non-obvious, project-specific rationale (why bare tool runs differ from CI runs, why unadjudicated verdicts get re-reported forever) with zero padding or explanation of concepts Claude already knows. The closing one-liner 'Competitor output is a lead, not ground truth' is load-bearing, matching the 'lean and efficient; every token earns its place' anchor.

5 / 5

Actionability

Concrete guidance dominates: run comparison tools 'as the project's CI or `package.json` script runs it, with the same flags and preprocessors', record in '`tests/conformance/adjudications.json`', 'retain only net improvements', and the command 'Run `review`'. It falls short of 5 because the adjudication record format, the classification method, and what 'review' invokes are left unspecified.

4 / 5

Workflow Clarity

The 8-step sequence has an explicit verification checkpoint (step 3), a classification gate (step 4), a record-before-fix ordering (step 5), and a closed feedback loop (step 7: re-run the full corpus and retain only net improvements before the final review). This matches the anchor for clear sequence with explicit validation steps and feedback loops; the only opacity ('Run `review`') is too minor to drop to 4.

5 / 5

Progressive Disclosure

The skill is under 50 lines with no bundle files (no references/, scripts/, or assets/ exist) and no nested references; the only file path mentioned (tests/conformance/adjudications.json) is a project output, not a navigation target. Per the rubric's simple-skill note, a short self-contained skill with well-organized content scores 5.

5 / 5

Total

19

/

20

Passed

Description

53%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description communicates a specific, real purpose (a conformance/improvement loop for Fallow) but omits any 'when to use' trigger guidance, which caps its completeness and weakens trigger-term quality. Adding an explicit 'Use when...' clause with natural terms like 'conformance', 'false positives', or 'benchmarking against other tools' would materially raise the score.

Suggestions

Add an explicit 'Use when...' clause, e.g. 'Use when Fallow results disagree with other tools, when conformance regressions appear, or when the daily lane re-reports unadjudicated disagreements.'

Include natural trigger terms users would actually say — 'conformance', 'false positives', 'benchmark Fallow against other tools', 'ground truth' — instead of only project-specific phrasing like 'verified source truth' and 'stable real-world corpus'.

Consider naming one or two more concrete actions (e.g. 'classify false positives/negatives and record adjudications') to broaden capability coverage beyond the single compare-and-improve loop.

DimensionReasoningScore

Specificity

The description names the domain ('Fallow analysis accuracy') and one composite capability ('comparing it with competing tools and verified source truth across a stable real-world corpus'), matching the anchor for naming a domain with 1-2 concrete actions but not comprehensive coverage. It does not list several distinct specific actions that would merit a 4.

3 / 5

Completeness

The 'what' is clear — iteratively improve Fallow analysis accuracy via comparison with competing tools and verified source truth — but there is no 'Use when...' clause or equivalent trigger guidance, which caps completeness at 3 per the judging guidelines. It is not a 2 because the 'what' is specific, not vague.

3 / 5

Trigger Term Quality

Relevant keywords like 'Fallow analysis', 'competing tools', and 'accuracy' are present, but natural user phrases such as 'conformance', 'benchmark', 'false positives', or 'ground truth' are missing. This is 'some relevant keywords but missing common variations or synonyms' rather than good coverage.

3 / 5

Distinctiveness Conflict Risk

The Fallow-specific niche ('improve Fallow analysis accuracy') is mostly distinct with only minor overlap risk against a closely related 'run Fallow' or general QA skill. It is not a 5 because the single sentence lacks the explicit trigger phrases that would make the niche unmistakable.

4 / 5

Total

13

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

fallow-rs/fallow

Path

.claude/skills/conformance-loop/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.