CtrlK
BlogDocsLog inGet started
Tessl Logo

harness-eval

This skill should be used when the user asks to "test the harness", "run integration tests", "validate features with real API", "test with real model calls", "run agent loop tests", "verify end-to-end", or needs to verify OpenHarness features on a real codebase with actual LLM calls.

66

Quality

80%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./.claude/skills/harness-eval/SKILL.md

The canonical home for this skill is harness-eval in HKUDS/OpenHarness

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured, highly actionable eval playbook with a clear sequenced workflow, validation checkpoints, failure classification, and clean one-level-deep references. The main improvement is tightening the repeated max_turns/timeout guidance and moving some scenario detail into the reference files.

DimensionReasoningScore

Conciseness

The body is dense with specific, actionable guidance and avoids explaining concepts Claude already knows, but the max_turns/timeout messaging is repeated across sections 2, 5, 7, and Common Pitfalls and could be trimmed.

4 / 5

Actionability

Copy-paste-ready bash commands, a concrete results table, and named scenarios with success criteria give mostly executable guidance; the in-body Python snippet is a sketch that relies on references/test-patterns.md for full executability, a minor gap.

4 / 5

Workflow Clarity

A clear 7-step sequence is paired with explicit validation (sandbox smoke check, tool-call assertions), an error-recovery feedback loop ('classify it before changing code'), and a Feature Coverage Checklist, matching the top anchor.

5 / 5

Progressive Disclosure

Two well-signaled, one-level-deep references (test-patterns.md, feature-matrix.md, both verified to exist) keep navigation easy, but the body is fairly heavy with repeated timeout guidance and detailed scenario specs that could be offloaded to references.

4 / 5

Total

17

/

20

Passed

Description

78%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description uses proper third-person voice and excels at explicit 'when to use' guidance with concrete trigger phrases, clearly answering both what and when. Its main weakness is that the quoted list over-indexes on testing-synonym triggers rather than enumerating distinct capabilities.

Suggestions

Lead with 2-3 distinct concrete actions the skill performs (e.g. 'Runs real multi-turn agent loops, exercises hooks/skills/plugins, and classifies end-to-end failures') before the trigger list, to strengthen capability specificity.

Add a couple of natural synonyms such as 'integration testing' or 'smoke test the harness' to broaden trigger-term coverage.

DimensionReasoningScore

Specificity

The only true capability statement is 'verify OpenHarness features on a real codebase with actual LLM calls'; the long quoted list is mostly trigger-term variants of 'test/verify' rather than distinct concrete actions, so it names the domain and 1-2 actions but is not comprehensive.

3 / 5

Completeness

It explicitly answers both what ('verify OpenHarness features on a real codebase with actual LLM calls') and when, with concrete quoted trigger phrases — matching the anchor that requires both with explicit triggers.

5 / 5

Trigger Term Quality

Natural user phrases like 'test the harness', 'run integration tests', and 'verify end-to-end' give good keyword coverage, though a few synonyms (e.g. 'integration testing', 'smoke test') are missing.

4 / 5

Distinctiveness Conflict Risk

The named product 'OpenHarness' plus 'agent loop tests' and 'real LLM calls' carve a clear niche, but generic testing phrases like 'run integration tests' carry minor overlap risk with general testing skills.

4 / 5

Total

16

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository
ProwlrBot/prowlr-cli
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.