CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

evaluation-methodology

PluginEval quality methodology, covering dimensions, rubrics, and scoring formulas. Use this skill when understanding how plugin quality is measured, when interpreting a low score on a specific dimension, when deciding how to improve a skill's triggering accuracy or orchestration fitness, when setting score thresholds for your marketplace, or when explaining quality badges to external partners like Neon.

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured reference skill: executable commands, an explicit scoring formula, a machine-readable output example, and clean deferral of rubric anchors and fix guides to real bundle files. Its weaknesses are minor — some repeated caveats across sections and troubleshooting that is reactive rather than woven into an explicit interpretation workflow.

DimensionReasoningScore

Conciseness

The body is dense and factual, using tables and formulas rather than padding, and explains only non-obvious specifics (e.g., 'The label names the depth that ran, not a check against human judgment'). It is not a 5 because minor redundancy could be trimmed: the experimental-layers caveat appears in both the intro and Usage, and plugin-directory static-only behavior is stated in three places. Not a 3 because there is no over-explanation of concepts Claude already knows.

4 / 5

Actionability

Fully executable guidance: a copy-paste-ready CLI block ('plugin-eval score ./path/to/skill --depth quick --output json --threshold 70') with exit-code semantics, an explicit penalty formula, and a parseable JSON example naming the exact field scripts should read ('composite.score'). Common cases are covered completely, matching the 5 anchor rather than 4.

5 / 5

Workflow Clarity

The composite-score pipeline is clearly sequenced ('First... blends the layer scores... Second, it sums... Third, it multiplies'), and Troubleshooting provides feedback loops ('check layers[0].anti_patterns', 'install the LLM extra with uv sync --extra llm'). Not a 5 because validation checkpoints are reactive troubleshooting rather than built into an explicit step-by-step procedure; not a 3 because sequence and error-recovery loops are clearly present.

4 / 5

Progressive Disclosure

A well-sectioned overview that pushes detail to real, one-level-deep, clearly signaled references — both cited files exist in the bundle ('The judge rubric anchors are in references/rubrics.md', 'Fixes for each anti-pattern and tips for each dimension are in references/improving-scores.md') — and keeps the body at overview altitude. The external pointer to 'evals/README.md at the repository root' is labeled with its location, so navigation remains unambiguous, fitting the 5 anchor.

5 / 5

Total

18

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: explicit and detailed 'when' guidance with multiple concrete trigger contexts, a clear named-tool niche, and domain-specific keywords. Its only weakness is that the 'what' side leans on usage contexts rather than enumerating the tool's actual capabilities (score, certify, compare), leaving a few natural trigger terms unsaid.

DimensionReasoningScore

Specificity

Names the domain ('PluginEval quality methodology, covering dimensions, rubrics, and scoring formulas') and lists several concrete actions ('understanding how plugin quality is measured, when interpreting a low score... when deciding how to improve... when setting score thresholds... when explaining quality badges'). It is not a 5 because it does not comprehensively state the tool's capabilities (e.g., scoring, certifying, comparing skills), and not a 3 because it goes well beyond naming 1-2 actions.

4 / 5

Completeness

Explicitly answers both what ('PluginEval quality methodology, covering dimensions, rubrics, and scoring formulas') and when ('Use this skill when understanding... when interpreting... when deciding... when setting... when explaining...') with five concrete trigger clauses. Clear match to the 5 anchor rather than 4, since the 'when' is fully explicit rather than merely present.

5 / 5

Trigger Term Quality

Good coverage of natural phrases users would say: 'low score on a specific dimension', 'triggering accuracy', 'orchestration fitness', 'score thresholds', 'quality badges'. It is not a 5 because common variations like 'evaluate a plugin', 'score a skill', or 'certify' are absent; not a 3 because coverage is broad rather than partial.

4 / 5

Distinctiveness Conflict Risk

A clear niche tied to a named tool ('PluginEval') with distinct, specific trigger phrases (dimension scores, thresholds, badges) and minimal overlap risk with sibling skills. Fits the 'clear niche with distinct triggers' anchor rather than the 4 anchor, which requires some overlap risk.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

wshobson/agents

Path

plugins/plugin-eval/skills/evaluation-methodology/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.