CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

agent-evaluation-reporting

Use when summarizing agent evaluations where autonomous, assisted, failed, timed-out, or invalid outcomes must remain distinct and comparable.

Quality

82%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A rigorous, well-structured methodology skill: concrete outcome taxonomy, denominator-locked formulas, explicit validation and reconciliation checkpoints, and a fully worked example that checks out arithmetically. Its only real weaknesses are minor cross-section repetition and a single-file structure slightly denser than a pure overview.

DimensionReasoningScore

Conciseness

The body is dense, domain-specific methodology with essentially no explanation of concepts Claude already knows, and the worked example is arithmetically consistent. Minor redundancy between Steps 2-4 and the Best Practices/Common Pitfalls sections (e.g., the success-only P50 warning appears in both Step 4 and Pitfalls) keeps it below anchor 5's every-token-earns-its-place.

4 / 5

Actionability

For an instruction-only skill the guidance is fully actionable: a concrete mutually-exclusive outcome taxonomy table, an explicit field-preservation list, copy-paste-ready metric formulas, denominator reconciliation checks, and a complete worked numeric example (48/108 = 44.4%, 72/120 = 60.0%) covering the common case.

5 / 5

Workflow Clarity

Six clearly sequenced steps (freeze contract, build ledger, lock denominators, latency/cost populations, uncertainty, decision gates) with explicit validation checkpoints: ledger sums must reconcile to N_all/N_eval/T_all, zero denominators yield 'unavailable' and 'inconclusive' gates, and non-equivalent conditions are flagged. No destructive or batch operations, so no cap applies.

5 / 5

Progressive Disclosure

No bundle files exist, and the single ~125-line file is consistently sectioned (Overview, When to Use, six steps, Example, Best Practices, Limitations, Pitfalls) making it easy to navigate. It exceeds the under-50-line simple-skill exception and keeps all detail inline, fitting anchor 4's 'good structure, most content appropriately placed' rather than the reference-split structure of anchor 5.

4 / 5

Total

18

/

20

Passed

Description

70%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A focused, well-scoped description with an explicit 'Use when' clause and distinctive outcome vocabulary. Its main weakness is a thin 'what': it names only 'summarizing' rather than the concrete capabilities the skill delivers (denominator-locked rates, ledger building, decision gates).

Suggestions

State the 'what' more concretely alongside the trigger, e.g., 'Summarize agent evaluation runs into decision-ready reports: build a mutually exclusive outcome ledger (autonomous, assisted, failed, timed-out, invalid), lock each rate to an explicit denominator, and map evidence to predeclared decision gates.'

Add one or two natural trigger variations users would actually say, such as 'report benchmark or eval results', 'success rates', or 'agent run report', to broaden trigger coverage without losing the niche.

Differentiate the trigger from the related @agent-evaluation design skill, e.g., 'Use when reporting or summarizing completed evaluation runs (not when designing the evaluations themselves).'

DimensionReasoningScore

Specificity

The description names the domain ('summarizing agent evaluations') and one concrete action plus a precise constraint ('autonomous, assisted, failed, timed-out, or invalid outcomes must remain distinct and comparable'), matching the anchor for domain plus 1-2 concrete actions. It does not list several specific actions (no mention of rates, denominators, or decision gates), so it falls short of anchor 4.

3 / 5

Completeness

Both 'what' ('summarizing agent evaluations... outcomes must remain distinct and comparable') and an explicit 'when' ('Use when summarizing...') are present. The 'what' is thin — a single verb with no concrete capabilities like rate reporting or gate evaluation — so it does not clearly match anchor 5's fully explicit what-and-when.

4 / 5

Trigger Term Quality

Good natural keyword coverage — 'summarizing', 'agent evaluations', 'outcomes', 'failed', 'timed-out' — that a user reporting eval runs would plausibly say. A few natural terms are missing (e.g., 'report', 'benchmark', 'success rate', 'eval results'), keeping it below the comprehensive-synonyms coverage of anchor 5.

4 / 5

Distinctiveness Conflict Risk

A clear niche (outcome-population-distinct evaluation reporting) with distinctive trigger vocabulary ('autonomous, assisted, timed-out, invalid'), but the phrase 'agent evaluations' overlaps with the closely related @agent-evaluation skill, giving minor overlap risk consistent with anchor 4 rather than the minimal-conflict anchor 5.

4 / 5

Total

15

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

sickn33/agentic-awesome-skills

Path

plugins/agentic-awesome-skills-claude/skills/agent-evaluation-reporting/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.