CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

evaluate-skill

Evaluate a local Codex skill in engineer-friendly terms. Use when the user says "evaluate this skill", "give me an analysis of the game dev skill", "audit this skill", "why did this score that way", "what should I fix first", or asks for a skill-specific report before benchmarking it.

67

Quality

84%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

71%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-organized, lean routing skill with a clear sequenced workflow and a concrete command reference, but it carries mild redundancy with its own frontmatter and its single external reference is a broken relative link that escapes the skill directory — ironically one of the very defects this skill's priorities list tells it to check for.

Suggestions

Fix or remove the broken reference: "../../references/chat-first-workflows.md" does not exist and the path escapes the skill directory; point it at a real file inside the bundle (e.g. "references/chat-first-workflows.md") so the Reference section is navigable.

Drop or trim the "Chat Requests To Recognize" section — it duplicates the trigger phrases already in the frontmatter description — and merge any unique variants into that description to save body tokens.

Add a brief error-recovery note to the workflow (e.g., what to do when the named skill cannot be resolved under ~/.codex/skills/ or repo-local skills/, or where the <usage.jsonl> file for measurement-plan comes from) to close the remaining actionability and workflow gaps.

DimensionReasoningScore

Conciseness

The body is lean (~50 lines), assumes Claude's competence, and explains nothing it already knows, but the "Chat Requests To Recognize" section largely duplicates the trigger phrases already in the frontmatter description and workflow steps 1–4 overlap somewhat (steps 3 and 4 both route to plugin-eval runs), matching anchor 4 ("Efficient; minor instances... that could be trimmed") rather than anchor 5's every-token-earns-its-place.

4 / 5

Actionability

The Commands section gives concrete copy-paste invocations ("plugin-eval analyze <skill-path> --format markdown", "plugin-eval init-benchmark <skill-path>") and the workflow binds each to a specific condition, but a few placeholders remain underspecified ("--observed-usage <usage.jsonl>" with no guidance on where that file comes from), matching anchor 4 ("Mostly executable guidance... with minor gaps") rather than anchor 5's fully copy-paste-ready coverage.

4 / 5

Workflow Clarity

The 10-step workflow is clearly sequenced with a default entrypoint, conditional routing (analyze → init-benchmark → measurement-plan → improve-skill), and step 5 acts as an explicit checkpoint (review "At a Glance", "Fix First" before drilling in). It is not a destructive or batch operation, so no validation cap applies; it falls just short of anchor 5 because there are no error-recovery checkpoints (e.g., what to do when the skill path doesn't resolve).

4 / 5

Progressive Disclosure

Section structure is good (Workflow, Priorities, Commands, Reference) but the single reference — "../../references/chat-first-workflows.md" — is broken (the file does not exist) and points outside the skill directory, so navigation to detail content fails. This matches anchor 3 ("Some structure but could be better organized; references present but not..." usable) rather than anchor 4, since the only reference cannot actually be followed; it is above anchor 2 because the body itself is well organized and nothing is improperly inlined.

3 / 5

Total

15

/

20

Passed

Description

90%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it pairs a concrete capability statement with an explicit and richly quoted "Use when" clause containing natural user trigger phrases. The only soft spot is that the "what" is a single action ("evaluate"), with the analysis/audit/report capabilities conveyed indirectly through the trigger list.

DimensionReasoningScore

Specificity

"Evaluate a local Codex skill in engineer-friendly terms" names the domain and a single concrete action; the capability statement is not expanded beyond "evaluate" — the other actions (analysis, audit, fix-first recommendations) appear only as user trigger phrasings, not stated capabilities, so this matches anchor 3 ("Names domain and 1-2 concrete actions, but not comprehensive") rather than anchor 4's "lists several specific actions".

3 / 5

Completeness

It explicitly answers "what" ("Evaluate a local Codex skill in engineer-friendly terms") and "when" via a "Use when..." clause with concrete trigger phrases, exactly matching anchor 5 ("Clearly and explicitly answers both what AND when with concrete trigger phrases").

5 / 5

Trigger Term Quality

The description quotes six natural user phrasings — "evaluate this skill", "give me an analysis of the game dev skill", "audit this skill", "why did this score that way", "what should I fix first", plus "skill-specific report before benchmarking" — giving comprehensive coverage of natural synonyms the way a user would actually say them, matching anchor 5.

5 / 5

Distinctiveness Conflict Risk

"local Codex skill", "skill-specific report before benchmarking", and scoring/benchmarking language establish a clear niche with distinct triggers and minimal conflict risk with other skills, matching anchor 5 rather than anchor 4, since even the broadest phrase ("audit this skill") is disambiguated by the surrounding evaluation context.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

openai/plugins

Path

plugins/plugin-eval/skills/evaluate-skill/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.