CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

advanced-evaluation

Design LLM-as-judge rubrics, direct scores and pairwise comparisons. Use for judge models, evals, position bias and calibration against human labels.

Quality

80%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/antigravity-advanced-evaluation/SKILL.md

The canonical home for this skill is advanced-evaluation in sickn33/agentic-awesome-skills

SKILL.md
Quality
Evals
Security

Quality

Content

70%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality instructional skill body with genuinely executable prompt templates, a thorough bias-mitigation protocol, and an exemplary calibration workflow with explicit validation and feedback loops. Its weaknesses are moderate verbosity in conceptual framing sections and a monolithic single-file structure that inlines worked examples and templates that would be better split into reference files.

Suggestions

Trim the meta-introduction, "Key insight" prose, and the Evaluation Taxonomy narrative to their actionable conclusions — the core value (biases + mitigations, metric table, protocols) stands without the conceptual framing Claude already knows.

Move the three full worked Examples and the complete prompt templates into a references/ file (e.g., references/templates.md and references/examples.md), keeping SKILL.md as a concise overview with clearly signaled one-level-deep links.

Replace placeholder example inputs like "Response A: [Technical explanation with jargon]" with short concrete responses so the position-swap example is fully self-contained and executable.

DimensionReasoningScore

Conciseness

The body is mostly efficient and skill-specific, but contains noticeable padding: the meta-intro ("This skill covers production-grade techniques... It synthesizes research from academic papers, industry practices"), the "Key insight" prose, and the conceptual Evaluation Taxonomy explanations that restate knowledge Claude already has. Not 4 because several sections could be trimmed without losing value; not 2 because the bulk is actionable, non-obvious material (protocols, templates, calibration steps).

3 / 5

Actionability

Gives mostly executable guidance: complete copy-paste prompt templates with variable slots ("## Original Prompt {prompt}... ## Response to Evaluate {response}"), an explicit position-swap protocol with concrete confidence rules ("Passes disagree: confidence = 0.5, verdict = TIE"), and worked JSON examples. Not 5 because several examples rely on placeholders ("Response A: [Technical explanation with jargon]") and Example 3's output is explicitly "abbreviated".

4 / 5

Workflow Clarity

The "Calibrate before trusting the judge" section is a clearly sequenced 6-step workflow with explicit validation checkpoints and feedback loops: pin the configuration and swap positions, "Compare judge and adjudicated human labels", "rerun an untouched held-out set", and "If the predeclared acceptance criteria fail... retain human review and report the unresolved limitation". The position-bias protocol adds its own consistency check and error-recovery path (disagree → TIE). Not 4 because checkpoints are explicit and comprehensive rather than having minor gaps.

5 / 5

Progressive Disclosure

Sections are well-organized with clear headers and an external-links "References" section is clearly signaled, but this is a ~430-line monolithic file with no bundle files at all; content that plausibly belongs in separate reference files (the three full worked Examples spanning ~80 lines, the detailed prompt templates) is fully inlined. Not 2 because structure is genuinely good and nothing is buried; not 4 because substantial self-contained content that would benefit from splitting remains inline.

3 / 5

Total

15

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that follows the best-practice pattern: a concrete what-clause followed by an explicit "Use for..." trigger list. Minor room for improvement in adding synonym variations and sharpening distinctiveness from a foundational evaluation skill.

DimensionReasoningScore

Specificity

"Design LLM-as-judge rubrics, direct scores and pairwise comparisons" lists three concrete actions in a named domain, matching the several-specific-actions anchor. Not 5 because the what-clause omits parts of the skill's actual coverage (bias mitigation, calibration workflow); not 3 because it goes beyond 1-2 actions.

4 / 5

Completeness

Both halves are explicit and concrete: the what ("Design LLM-as-judge rubrics, direct scores and pairwise comparisons") and an explicit trigger clause ("Use for judge models, evals, position bias and calibration against human labels") with concrete phrases, matching the top anchor's structure. Not 4 because the when-clause is already explicit and specific rather than merely present.

5 / 5

Trigger Term Quality

"judge models, evals, position bias and calibration against human labels" provides good natural-keyword coverage — users working on evals would plausibly say "evals", "LLM-as-judge", "position bias". Not 5 because common synonyms and phrasings like "LLM judge", "compare responses", or "grading" are missing.

4 / 5

Distinctiveness Conflict Risk

Terms like "LLM-as-judge rubrics", "pairwise comparisons", and "position bias" carve out a distinct niche with mostly distinct triggers. Not 5 because "evals" and "judge models" are broad enough to overlap with a general/foundational evaluation skill; not 3 because the niche is clearly defined.

4 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

boisenoise/skills-collections

Path

skills/antigravity-advanced-evaluation/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.