CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

eval

Evaluate and rank agent results by metric or LLM judge for an AgentHub session. Use when the user runs /hub:eval or asks to score, compare, or pick a winner among completed AgentHub agents.

69

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-built command skill: concise mode documentation, fully executable commands for each mode, clear mode-selection logic, and appropriately placed script references. The main gaps are minor — a redundant second example output table, no error-handling checkpoints in the eval workflow, and script references that cannot be verified against the provided bundle.

Suggestions

Trim one of the two example output tables (e.g., keep only the metric-mode output) to cut tokens without losing clarity.

Add a brief checkpoint in the workflow: what to do if the eval command fails or an agent has no diff/result post, and verify rankings exist before running the session-state update.

Confirm the referenced scripts (scripts/result_ranker.py, scripts/session_manager.py) exist in the skill bundle, or note where they live, so the paths are verifiable.

DimensionReasoningScore

Conciseness

The body is lean and assumes Claude's competence ('Rank all agent results for a session. Supports metric-based evaluation (run a command), LLM judge (compare diffs), or hybrid.') with no explanation of known concepts. The two full example output tables — 'RANK AGENT METRIC DELTA FILES...' and the LLM judge verdict table — are illustrative padding that could be trimmed to one example, matching the 'efficient; minor instances of over-explanation' anchor.

4 / 5

Actionability

Fully executable guidance: a copy-paste metric command with all flags ('python {skill_path}/scripts/result_ranker.py --session {session-id} --eval-cmd "{eval_cmd}" --metric {metric} --direction {direction}'), a concrete git diff command and result-post path for LLM judge mode, a specific 10% tie-break rule for hybrid mode, and an exact state-update command. Placeholders are inherent variable slots, and the common cases (each mode) are covered with concrete examples.

5 / 5

Workflow Clarity

Mode selection and step sequences are clear — metric when configured, LLM judge on '--judge flag' or absence of config, hybrid with a numbered 3-step flow, plus a sequenced 'After Eval' section. It sits at 4 rather than 5 because there are no checkpoints for failure cases (eval command errors, empty diffs, missing result posts) and no verification that rankings were produced before updating session state; the operation is read-only evaluation, so the destructive/batch cap does not apply.

4 / 5

Progressive Disclosure

Well-organized single-file structure with clearly signaled one-level-deep script references ('{skill_path}/scripts/result_ranker.py', '{skill_path}/scripts/session_manager.py') and inline mode docs that rightly stay in SKILL.md. It is not a 5: the referenced scripts are not present in the provided bundle (no scripts/ directory), and the 'Compare all diffs and rank by: Correctness / Simplicity / Quality' criteria plus judging details could be outlined with slightly clearer navigation for a longer body.

4 / 5

Total

17

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description in third-person voice that clearly states what the skill does, both evaluation modes, and exactly when to use it via concrete trigger phrases and the command name. Only minor refinements — naming the hybrid mode and a few more natural synonyms — would make it fully comprehensive.

DimensionReasoningScore

Specificity

Names concrete actions — 'Evaluate and rank agent results by metric or LLM judge for an AgentHub session' — including the two evaluation modes. Falls just short of the 5 anchor because it omits the hybrid mode and 'update session state / recommend merge' actions covered in the body, leaving minor coverage gaps.

4 / 5

Completeness

Explicitly answers both questions: what ('Evaluate and rank agent results by metric or LLM judge for an AgentHub session') and when ('Use when the user runs /hub:eval or asks to score, compare, or pick a winner among completed AgentHub agents') with concrete trigger phrases and an explicit 'Use when' clause.

5 / 5

Trigger Term Quality

Includes natural user phrases 'asks to score, compare, or pick a winner' plus the explicit command '/hub:eval' and the 'AgentHub' domain term. A few natural variations ('evaluate results', 'judge the outputs', 'which agent is best') are missing, so it fits the 'good keyword coverage; a few natural terms missing' anchor rather than comprehensive.

4 / 5

Distinctiveness Conflict Risk

Scoped tightly to 'AgentHub session' and '/hub:eval' with trigger terms specific to completed-agent evaluation ('pick a winner among completed AgentHub agents'). A clear niche with distinct triggers and minimal conflict risk against generic evaluation or ranking skills.

5 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Repository

alirezarezvani/claude-skills

Path

engineering/agenthub/skills/eval/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.