CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/llm-regression-suite-author

Use when upgrading an LLM model or provider needs a repeatable before/after quality gate, or prompt quality must be tracked across model versions. Builds a versioned golden dataset, deterministic runs, exact, semantic, judge and rubric checks, and a pass-rate CI gate with a baseline diff.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality, execution-ready skill: deterministic eval configuration, layered assertion strategy, baseline capture, threshold diffing, and CI gating are all conveyed through complete, runnable examples with explicit validation and a recovery loop. The only weaknesses are minor verbosity (duplicated link definitions) and missed opportunities to move the CI workflow and diff script into bundle files.

DimensionReasoningScore

Conciseness

The body is code-first and dense, but minor padding could be trimmed: the 10 link-reference definitions at the top are restated in the References section, and framing sentences like "Non-determinism is the primary enemy of regression suites" add little — matching the 4 anchor (efficient with minor over-explanation) rather than the every-token-earns-its-place 5 anchor.

4 / 5

Actionability

Every step ships copy-paste-ready artifacts: a complete promptfooconfig YAML, executable GEval Python with pinned judge models, a full regression_diff.py script, CLI commands with flags, and a GitHub Actions workflow — matching the 5 anchor for fully executable guidance covering common cases.

5 / 5

Workflow Clarity

Six clearly sequenced steps include explicit validation checkpoints (baseline pass rate as the floor, ratio threshold with exit code 1, CI non-zero exit on failure), an error-recovery feedback loop via promptfoo's --filter-failing flag, and an anti-patterns table serving as a checklist — matching the 5 anchor.

5 / 5

Progressive Disclosure

No bundle files exist, and the single SKILL.md is well-sectioned with clearly signaled one-level-deep external references and a References index; however, roughly 370 lines are all inline — the full CI workflow YAML and the diff script are content that could live in bundle files, and scripts/regression_diff.py is referenced as a path without an accompanying file — matching the 4 anchor (good structure, minor organization gaps) rather than the 5 anchor.

4 / 5

Total

18

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person voice, explicit dual trigger scenarios, and a comprehensive list of concrete capabilities. The only gaps are a few natural trigger synonyms (especially "regression") and slight overlap in the prompt-quality-tracking clause with general evaluation skills.

DimensionReasoningScore

Specificity

"Builds a versioned golden dataset, deterministic runs, exact, semantic, judge and rubric checks, and a pass-rate CI gate with a baseline diff" lists multiple concrete actions covering the whole workflow, matching the comprehensive-coverage anchor rather than the minor-gaps anchor at 4.

5 / 5

Completeness

An explicit "Use when..." clause gives two concrete trigger scenarios and the third-person "Builds a..." sentence states what the skill does, clearly and explicitly answering both what and when as in the 5 anchor.

5 / 5

Trigger Term Quality

Natural phrases like "upgrading an LLM model", "before/after quality gate", and "model versions" are present, but common variations such as "regression testing", "model migration", or "eval suite" are missing — notably "regression" itself never appears — so it falls short of the synonym-level coverage of the 5 anchor.

4 / 5

Distinctiveness Conflict Risk

The versioned-dataset/pass-rate-gate framing carves a clear niche, but "prompt quality must be tracked across model versions" overlaps with generic prompt-evaluation skills, matching the 4 anchor (mostly distinct, minor overlap with closely related skills) rather than the minimal-conflict 5 anchor.

4 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 2 missing

Warning

Total

15

/

16

Passed

Reviewed

On this page