CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

eval-creator

[Beta] Creates permanent eval cases from promoted learnings and runs regression checks against them. Turns failures into test cases that prevent silent regression. This is the outer loop's regress-test step. Use when a learning is promoted and has a clear pass/fail condition, or on cadence to verify promoted rules still hold.

63

Quality

79%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./plugin/skills/eval-creator/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

63%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable process skill whose core spec (eval case format, verification methods, execution sequence with validation checkpoints) is solid. Its weaknesses are inlining two tangential sections instead of splitting them into reference files, and carrying padding (a blog quote, integration commentary) that inflates token cost.

Suggestions

Move the Skill Validation section and the Custom Verification Methods (mcp-scripts) example into separate reference files (e.g. references/skill-check.md, references/script-check.md), leaving one-line pointers in SKILL.md.

Delete the blog-quote paragraph and compress the Integration/Persistence sections into a short bullet list; they explain ecosystem context rather than instructing the agent.

Give 'Run by Pattern-Key' and 'Run by Area' concrete mechanics (e.g. the actual filter/read procedure on .evals/EVAL_INDEX.md or case frontmatter) to match the specificity of the rest of the execution workflow.

DimensionReasoningScore

Conciseness

The body is mostly efficient, load-bearing spec (eval case template, verification methods, execution steps), but includes more than minor padding: an inspirational blog quote ("The blog says: 'If a failure taught you something important...'"), a ~55-line Skill Validation section, and Integration/Scheduled Use/Persistence sections that could be trimmed or split out.

3 / 5

Actionability

Concrete, executable guidance throughout: exact eval case template, concrete check blocks (`command: npm run typecheck` / `expect_exit: 0`), named tool usage ("Use Grep tool", "Run the command via Bash"), and an exact validation command (`python .claude/skills/skill-creator/scripts/quick_validate.py <target>`). Minor gaps: "Run by Pattern-Key" and "Run by Area" name the filters but give no concrete mechanics.

4 / 5

Workflow Clarity

The execution workflow has a clear numbered sequence with validation checkpoints (precondition check → skip, evidence-strength check → `insufficient_evidence`, "Re-run this eval to verify" recovery loop), so the batch-operation cap does not apply. It falls short of anchor 5 because the run-filtering subsections are thin one-liners and there is no consolidated run checklist.

4 / 5

Progressive Disclosure

No bundle files exist and the ~290-line body inlines substantial specialized content (the entire Skill Validation section and the Custom Verification Methods/mcp-scripts example) that clearly belongs in separate reference files. Section headers are clear, matching anchor 3 ("content that should be separate is inline") rather than 4.

3 / 5

Total

14

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, concrete, with an explicit 'Use when' clause carrying specific trigger conditions tied to its niche. The only soft spots are slightly incomplete action coverage and a few missing natural trigger variations.

DimensionReasoningScore

Specificity

"Creates permanent eval cases from promoted learnings and runs regression checks against them. Turns failures into test cases that prevent silent regression" names several concrete actions in third person, but coverage has minor gaps (the create/run/list modes and index updating are not described). Matches anchor 4 rather than 5 (not comprehensive) or 3 (more than 1-2 actions).

4 / 5

Completeness

It explicitly answers both what ("Creates permanent eval cases from promoted learnings and runs regression checks against them") and when with concrete trigger phrases ("Use when a learning is promoted and has a clear pass/fail condition, or on cadence to verify promoted rules still hold"). This matches anchor 5; the 'when' is explicit and specific, not merely adequate as in anchor 4.

5 / 5

Trigger Term Quality

Natural terms are present and relevant — "eval cases", "regression checks", "test cases", "pass/fail condition", "promoted rules" — with the workflow's own trigger phrasing ("when a learning is promoted... or on cadence"). A few natural variations are missing (e.g. "regression test", "verify the harness"), matching anchor 4 rather than 5.

4 / 5

Distinctiveness Conflict Risk

The niche is tightly scoped to the outer loop's regress-test step ("This is the outer loop's regress-test step", "promoted learnings"), with triggers unlikely to collide with general testing or document skills. Clear niche with minimal conflict risk, matching anchor 5.

5 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

pskoett/pskoett-ai-skills

Path

plugin/skills/eval-creator/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.