CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

eval-harness

Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles

Quality

65%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/eval-harness/SKILL.md

The canonical home for this skill is eval-harness in affaan-m/ECC

SKILL.md
Quality
Evals
Security

Quality

Content

67%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured, concrete reference with executable grader commands, clear eval templates, and a sequenced workflow with a full worked example. Its main weaknesses are redundancy between the main sections and the 'Product Evals (v1.8)' appendix, and the unimplemented '/eval' command surface that leaves the core run loop partially abstract.

Suggestions

Merge the 'Product Evals (v1.8)' appendix into the main 'Grader Types', 'Metrics', and 'Eval Storage' sections to eliminate the duplicated grader list, pass@k guidance, and artifact layout.

Replace placeholder steps like '[Run each capability eval, record PASS/FAIL]' with an executable mechanism (a script or concrete command sequence) for running evals and computing pass@k.

Add an explicit failure-recovery step to the Eval Workflow (e.g., 'If an eval fails: fix the code, re-run the eval, only proceed when all capability evals pass').

DimensionReasoningScore

Conciseness

The core content is dense, actionable templates rather than prose padding, but there is real duplication: grader types, pass@k guidance and thresholds, and the eval artifact layout each appear twice (main body and the 'Product Evals (v1.8)' appendix), and the 'Philosophy' section states concepts that are largely restated by 'When to Activate'. Mostly efficient but needs tightening — anchor 3; it avoids anchor 2 because it never explains concepts Claude already knows.

3 / 5

Actionability

Grader examples are copy-paste ready ('grep -q "export function handleAuth" src/auth.ts && echo "PASS" || "FAIL"', 'npm test -- --testPathPattern="auth"'), and eval/report templates are concrete. However, the central eval loop contains placeholders ('[Run each capability eval, record PASS/FAIL]') and the '/eval define|check|report' commands are referenced with no implementation or mechanism — minor gaps, anchor 4 rather than 5.

4 / 5

Workflow Clarity

The Define → Implement → Evaluate → Report workflow is clearly sequenced with a template and checklist for each phase, and eval definitions naturally serve as validation checkpoints. It falls short of anchor 5 because there is no explicit failure-recovery feedback loop (what to do when an eval fails mid-implementation is left implicit).

4 / 5

Progressive Disclosure

As a single-file skill with no bundle files, it relies on well-organized sections, which are logical and easy to navigate (activation triggers, eval types, graders, metrics, workflow, storage, examples). The main gap is that the 'Product Evals (v1.8)' appendix duplicates main-body content instead of being merged or split into a reference file — minor organization gaps, anchor 4.

4 / 5

Total

15

/

20

Passed

Description

48%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description identifies a clear niche (eval-driven development for Claude Code) but is abstract: it names no concrete actions and provides no 'Use when...' trigger guidance, capping completeness. Adding explicit capabilities (define evals, run pass@k metrics, generate reports) and activation conditions would substantially improve it.

Suggestions

Add a 'Use when...' clause listing activation triggers, e.g. 'Use when setting up evals, defining pass/fail criteria for agent tasks, or measuring pass@k reliability.'

Replace the abstract 'implementing eval-driven development (EDD) principles' with 2-3 concrete actions such as 'define capability and regression evals, run code/model/human graders, and track pass@k metrics'.

Include natural trigger terms users would actually say: 'evals', 'pass@k', 'regression testing', 'agent reliability', 'benchmarking'.

DimensionReasoningScore

Specificity

The description names the domain ("Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles") but states no concrete actions — it never mentions defining evals, measuring pass@k, or generating reports, which the body actually covers. It matches anchor 2 ('names the domain but actions are minimal or generic') rather than 3 because no specific capability is listed.

2 / 5

Completeness

The 'what' is present (a formal evaluation framework implementing EDD principles) but the 'when' is entirely absent — there is no 'Use when...' clause or equivalent trigger guidance, which caps completeness at 3 per the judging guidelines. It does not reach 4 because nothing implies activation conditions.

3 / 5

Trigger Term Quality

Terms like "evaluation framework", "eval-driven development", and "EDD" are relevant, but the description misses natural variations users would say such as "evals", "pass@k", "regression testing", or "benchmarking agent performance". Some relevant keywords exist, but common synonyms are missing — anchor 3.

3 / 5

Distinctiveness Conflict Risk

The EDD/eval-harness niche is fairly distinct from unrelated skills, with only minor overlap risk against generic testing or code-review skills (e.g., a user asking to 'evaluate this code'). It does not reach 5 because the absence of explicit triggers leaves moderate risk of firing on generic evaluation requests.

4 / 5

Total

12

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

valeriibeck-star/claude-skills

Path

skills/eval-harness/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.