CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

plugin-eval

Help engineers evaluate a local skill or plugin, explain why it scored that way, show what to fix first, measure real token usage, benchmark starter scenarios, or decide what to run next. Use when the user says things like "evaluate this skill", "give me an analysis of the game dev skill", "why did this score that way", "what should I fix first", "measure the real token usage of this skill", or "what should I run next?".

70

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured router skill body: lean, sectioned, with concrete executable commands, a clear routing sequence, and a name-resolution checkpoint. Main gaps are triplicated chat-phrase lists, unexplained secondary commands with no output-validation step, and a bare References list whose `../../` paths point outside the bundle and are unannotated.

Suggestions

Collapse the duplication: the chat phrases appear in the frontmatter description, Start Here step 3, and again in 'Chat Requests To Recognize' — keep one routing table and delete the redundant list (conciseness).

Annotate each reference with what it covers and when to read it (e.g. '**Routing workflows**: see chat-first-workflows.md'), and move the referenced files inside the skill bundle or use paths that resolve from SKILL.md (progressive_disclosure).

Briefly state what measurement-plan/init-benchmark/benchmark expect and add a quick success check after `plugin-eval analyze` before initializing the benchmark (actionability, workflow_clarity).

DimensionReasoningScore

Conciseness

The body is lean (~75 lines) with no explanation of concepts Claude already knows, but the same chat phrases appear three times (frontmatter, Start Here step 3, and again verbatim in "Chat Requests To Recognize"), and "Matching Commands" repeats commands already shown in Start Here. Not a 5 due to these redundant duplicate lists; not a 3 because there is no padding or over-explanation — the duplication is lists, not prose.

4 / 5

Actionability

Gives concrete runnable commands with full flags (e.g. `plugin-eval start <path> --request "<user request>" --format markdown`) plus a concrete name-resolution procedure (check `~/.codex/skills/<skill-name>`, then repo-local `skills/<skill-name>`). Not a 5: commands use unresolved `<path>`/`<user request>` placeholders and several commands (measurement-plan, init-benchmark, benchmark) get no explanation of their inputs or outputs; not a 3 because most guidance is directly executable.

4 / 5

Workflow Clarity

"Start Here" is a coherent numbered routing sequence (resolve target type → route via the router → map natural requests → hand off rewrite/custom-rubric requests → resolve named skills → fuller analysis path) with an explicit checkpoint: "if the name is still ambiguous, ask one short clarifying question before continuing". Not a 5: no validation of command success/output before proceeding (e.g. no check that analyze succeeded before init-benchmark); not a 3: the sequence and checkpoint are clearly present.

4 / 5

Progressive Disclosure

Short, well-sectioned overview with three references listed one level deep — appropriate structure. Not a 5: the References section is a bare list giving no signal of what each file covers, and the paths (`../../references/chat-first-workflows.md` etc.) escape the skill directory — none of the referenced files exist in this bundle, so they cannot be verified. Not a 3: the split between overview routing and reference detail is correct and navigation is easy.

4 / 5

Total

16

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, concrete multi-action capability list paired with an explicit 'Use when' clause containing natural quoted trigger phrases. Its only weakness is that the broad skill/plugin evaluation scope overlaps with several closely related sibling skills it routes to.

DimensionReasoningScore

Specificity

The description lists six concrete actions — "evaluate a local skill or plugin", "explain why it scored that way", "show what to fix first", "measure real token usage", "benchmark starter scenarios", "decide what to run next" — comprehensively covering the skill's analyze/explain/measure/benchmark surface. Not a 4: coverage spans every workflow the body exposes, with no meaningful gaps; not below 5 since every action is concrete rather than generic.

5 / 5

Completeness

Both halves are explicit: a clear "what" (the action list) and an explicit "when" clause — "Use when the user says things like ..." with concrete trigger phrases. Not a 4: the when-guidance is already as explicit and specific as the anchor-5 example.

5 / 5

Trigger Term Quality

It embeds exact natural sentence-form triggers users would say: "evaluate this skill", "give me an analysis of the game dev skill", "why did this score that way", "what should I fix first", "measure the real token usage of this skill", "what should I run next?". Not a 4: these are full phrasings with variations rather than just keywords; nothing important is missing.

5 / 5

Distinctiveness Conflict Risk

The "local skill or plugin" evaluation niche is mostly distinct and its trigger phrases are specific, but the description's scope overlaps with closely related siblings the body itself routes to (evaluate-skill, evaluate-plugin, improve-skill, metric-pack-designer). Not a 5: that sibling overlap is real; not a 3: the niche and triggers are clearly differentiated from unrelated skills.

4 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

openai/plugins

Path

plugins/plugin-eval/skills/plugin-eval/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.