CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

evaluate-plugin

Evaluate a local Codex plugin in engineer-friendly language. Use when the user says "evaluate this plugin", "audit this plugin", "why did this score that way", "what should I fix first", "help me benchmark this plugin", or asks for a plugin-wide report before comparing versions.

64

Quality

81%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

71%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A concise, mostly actionable skill body with a clear routed workflow and copy-paste commands. The main defects are a broken and unexplained lone reference (a path escaping the bundle that does not exist), duplicated content between the workflow and the commands/chat-request sections, and the absence of any validation or error-recovery steps.

Suggestions

Fix the reference: either create references/chat-first-workflows.md inside the bundle and link it as [chat-first workflows](references/chat-first-workflows.md) with a one-line description of what it covers, or remove the dangling "../../" path.

Deduplicate: drop the "Chat Requests To Recognize" section (already in the frontmatter description) and the commands repeated between the Workflow and Commands sections, keeping each command in one place.

Add a light validation checkpoint, e.g., confirm the target contains .codex-plugin/plugin.json before running plugin-eval, and state what to do if analyze reports errors.

DimensionReasoningScore

Conciseness

The body is lean with no explanation of concepts Claude already knows, but "Chat Requests To Recognize" restates six phrases already in the description and workflow, and the "Commands" block duplicates the start/analyze/compare invocations already shown in the workflow. These are minor trims, matching anchor 4 rather than anchor 5 ("every token earns its place").

4 / 5

Actionability

Commands are concrete and copy-paste ready with placeholders ("plugin-eval analyze <plugin-root> --format markdown"), but step 4's "Read `Fix First`" and step 6's "use the starter benchmark flow" are vague pointers with no location or content, so guidance is not fully executable (anchor 4, not 5).

4 / 5

Workflow Clarity

A clear ordered 7-step sequence with intent-based routing (steps 2, 6, 7) acting as decision checkpoints; the evaluation is read-only, so the destructive/batch validation cap does not apply. It falls short of anchor 5 because there are no feedback loops or validation steps (e.g., confirming the target has .codex-plugin/plugin.json before running, or what to do when a command fails).

4 / 5

Progressive Disclosure

Sections are well organized and the main file is appropriately lean, but the single external reference is a bare, undescribed relative path "../../references/chat-first-workflows.md" that points two levels outside the skill bundle and does not exist (no references/ directory is present in the bundle). This matches anchor 3 ("references present but not clearly signaled") rather than 4-5, which require well-signaled, working references; it is above anchor 2 because the inline content and section structure are sound.

3 / 5

Total

15

/

20

Passed

Description

82%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with an explicit trigger clause and natural, well-chosen trigger phrases. The main gap is specificity: the capability is described with a single verb, leaving the concrete evaluation operations (analyze, benchmark, compare) to the body rather than the description.

Suggestions

Enumerate the concrete evaluation operations in the 'what' portion, e.g., "Analyze manifests, score nested skills, benchmark usage, and compare versions of a local Codex plugin..." to lift specificity from one action to several.

Add one or two common synonym triggers such as "review this plugin" or "score this plugin" to round out trigger-term coverage.

DimensionReasoningScore

Specificity

"Evaluate a local Codex plugin in engineer-friendly language" names the domain and one concrete action, but does not enumerate the specific evaluation operations (analyze, score nested skills, benchmark, compare versions). It matches anchor 3 ("names domain and 1-2 concrete actions, but not comprehensive") and not anchor 4, which requires several listed specific actions.

3 / 5

Completeness

It explicitly answers "what" ("Evaluate a local Codex plugin in engineer-friendly language") and "when" with a "Use when the user says..." clause listing concrete trigger phrases, matching the anchor-5 example pattern exactly. It is not anchor 4, where the 'when' clause would be less explicit or specific.

5 / 5

Trigger Term Quality

Six quoted natural phrases users would say ("evaluate this plugin", "audit this plugin", "why did this score that way", "what should I fix first", "help me benchmark this plugin") give good keyword coverage. It falls short of anchor 5 because common variations and synonyms (e.g., "review this plugin", "score this plugin", file-extension triggers) are missing.

4 / 5

Distinctiveness Conflict Risk

"local Codex plugin" carves out a clear niche and all triggers are plugin-evaluation-specific phrases, so risk of triggering the wrong skill is minimal. Third person voice is used, consistent with anchor 5.

5 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

openai/plugins

Path

plugins/plugin-eval/skills/evaluate-plugin/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.