CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

agent-regression-evals

Use before shipping any agent, prompt, model or tool change, or when a pass-rate drop needs a verdict. Runs repeated trials, gates candidate vs baseline with paired statistics in regression_gate.py, checks tool-call trajectories and finds flaky cases.

Quality

94%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

100%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is an exemplary skill body: every command is executable and verified against the actual scripts, the multi-step workflow has explicit machine-enforced validation checkpoints and recovery paths, and the overview-to-references split is clean with all bundle files present. The only conceivable trim is the four-line motivational intro, and even that carries the skill's evidentiary premise.

DimensionReasoningScore

Conciseness

The 87-line body is dense throughout: a commented command block, mode-selection policy, gate conditions, bolded hard rules with one-clause rationales, a script table, and a references list. The only prose that is not instruction is the four-line intro, and each of its sentences justifies a component (repeated trials, path-vs-outcome grading), so no section could be cut without losing a rule's motivation. This matches anchor 5 — lean, assumes Claude's competence — rather than 4, which would require over-explanation that could be trimmed.

5 / 5

Actionability

All three workflow commands are complete and copy-paste ready with real flags (--spec, --k 3, --quarantine-out, --baseline, --candidate, --quarantine), the required JSONL row schema is shown inline, and the scripts table documents exit codes per script; the claimed "All support --sample and --output json" was verified against the actual scripts. This matches anchor 5 — fully executable, common cases covered (sample data files exist in assets) — not 4, since even step 0's output format is specified exactly.

5 / 5

Workflow Clarity

Steps 0-3 are numbered, sequenced, and paired with commands; the five explicit "The gate blocks on" conditions plus the warnings for underpowered drops and cost rises give the skill explicit validation checkpoints with machine-enforced exit codes. Although this is a batch-operation skill, the feedback-loop cap does not apply: recovery paths are specified (quarantine entries with owner/expiry re-enter the gate automatically, the power note says how many cases are needed when the sample is too small). Matches anchor 5, not 4, because checkpoints are explicit and enforced rather than merely listed.

5 / 5

Progressive Disclosure

SKILL.md is a true overview: workflow, gate conditions, and hard rules inline, with deep material split into three reference files each introduced by a one-line content summary (e.g. "pass@k vs pass^k, per-case averaging, paired CI, McNemar, power (7 sources)"). All seven referenced bundle files were verified to exist, and the references are one level deep (they cite script names, not further documents). Matches anchor 5 — clear overview, well-signaled one-level-deep references, appropriate split — not 4, since every reference is signaled with what it contains and when to open it.

5 / 5

Total

20

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it explicitly answers both what the skill does and when to use it, with concrete, verifiable actions that match the actual bundle. The main gap is keyword coverage — natural synonyms like "regression", "eval", and "benchmark" are missing from the trigger phrasing.

DimensionReasoningScore

Specificity

"Runs repeated trials, gates candidate vs baseline with paired statistics in regression_gate.py, checks tool-call trajectories and finds flaky cases" lists four concrete actions that map one-to-one onto the skill's components (trial running, statistical gate, trajectory grading, flake detection), even naming the gating script. This matches the anchor 'lists multiple specific concrete actions; comprehensive coverage' rather than 4, since there are no coverage gaps — every capability in the bundle is named.

5 / 5

Completeness

The 'what' is explicit ("runs repeated trials, gates candidate vs baseline with paired statistics..., checks tool-call trajectories and finds flaky cases") and the 'when' is an explicit Use clause with concrete triggers ("Use before shipping any agent, prompt, model or tool change, or when a pass-rate drop needs a verdict"). This clearly matches anchor 5 — both questions answered with concrete trigger phrases — not 4, where the 'when' would be present but less specific.

5 / 5

Trigger Term Quality

Natural phrases are present — "before shipping any agent, prompt, model or tool change", "pass-rate drop", "finds flaky cases" — which users would plausibly say. It falls short of anchor 5 because common synonyms like "regression", "eval", "evaluation", or "benchmark" are absent, so a user asking about a 'regression' or 'agent evals' in natural language would not hit these words; it is above anchor 3 because the terms present are varied and natural rather than domain-generic.

4 / 5

Distinctiveness Conflict Risk

The functional core ("gates candidate vs baseline with paired statistics", "checks tool-call trajectories", "pass-rate drop needs a verdict") carves a clear niche distinct from generic eval or analysis skills. It sits at anchor 4 rather than 5 because the trigger "before shipping any agent, prompt, model or tool change" is broad enough to overlap with adjacent prompt-governance or CI/deploy skills; it is well above anchor 3 since the statistical-gating actions are highly distinctive.

4 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

alirezarezvani/claude-skills

Path

engineering/agent-regression-evals/skills/agent-regression-evals/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.