CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

metric-pack-designer

Design custom metric packs for plugin-eval so teams can add local evaluation rubrics that emit schema-compatible checks and metrics. Use when the user wants their own evaluation criteria or visualizations.

64

Quality

80%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./plugins/plugin-eval/skills/metric-pack-designer/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

71%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An impressively lean body with a clear workflow and one executable command, but the load-bearing details (manifest format, output schema, script shape) are deferred to a reference that does not exist in the bundle, leaving the central step under-specified. Fixing the dangling `../../references/` path and inlining a minimal manifest example would resolve both weak dimensions.

Suggestions

Fix the reference path: `../../references/metric-pack-manifest.md` escapes the skill directory and points at no existing file. Either ship the file under the skill's own `references/` directory and link it as `[metric-pack manifest](references/metric-pack-manifest.md)`, or inline the manifest structure directly.

Inline a minimal manifest example (or a script skeleton that prints `checks[]`/`metrics[]` JSON to stdout) so the central workflow step 'Create a metric-pack manifest plus a script' is executable without the missing reference.

Add an error-recovery line after the analyze step (e.g., 'If plugin-eval reports schema violations, fix the flagged fields and re-run') to close the workflow's missing feedback loop.

DimensionReasoningScore

Conciseness

The body is ~20 lines with zero padding: no concept explanations, no filler — every line ("Emit only `checks[]`, `metrics[]`, and optional `artifacts[]`", "Keep IDs stable across runs") is actionable guidance Claude doesn't already know. Not below 5 because nothing could be trimmed without losing information.

5 / 5

Actionability

One fully executable command exists ("plugin-eval analyze <path> --metric-pack <manifest.json>") plus concrete field names, but the core step "Create a metric-pack manifest plus a script that prints JSON to stdout" has no manifest example, no output schema, and no script skeleton — the key details live in a reference that cannot be verified. Not a 4 because those missing details are essential to executing the main step, not a minor gap.

3 / 5

Workflow Clarity

The four-step Workflow (clarify → define payload → create manifest+script → run through plugin-eval analyze) is clearly sequenced, and step 4 doubles as a checkpoint. Not a 5 because there is no error-recovery guidance — what to do if the analyze step rejects the pack output is unaddressed.

4 / 5

Progressive Disclosure

Sections (Workflow / Design Rules / Reference) are well-organized for a short skill, but the single reference is a bare path `../../references/metric-pack-manifest.md` that escapes the skill directory two levels up and resolves to no existing file — no references/, scripts/, or assets/ directories exist in the bundle. Not a 4 because a dangling, non-linked reference with an out-of-bundle path is a navigation failure, not a minor organization gap.

3 / 5

Total

15

/

20

Passed

Description

78%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concise, third-person, names its niche tool explicitly, and includes both a concrete what and an explicit Use-when clause. It sits just below top marks only because trigger coverage lacks synonyms and the when-clause is slightly less specific than it could be.

DimensionReasoningScore

Specificity

Phrases like "Design custom metric packs for plugin-eval" and "emit schema-compatible checks and metrics" name several concrete, domain-specific actions in third person. Not a 5 because coverage stops at design/emit — it never mentions creating manifests, running the analysis, or what the emitted checks actually contain, leaving minor gaps.

4 / 5

Completeness

Both parts are present: a clear what ("Design custom metric packs... that emit schema-compatible checks and metrics") and an explicit when ("Use when the user wants their own evaluation criteria or visualizations"). Not a 5 because the when-clause could be more specific — it doesn't tie triggers to plugin-eval or metric packs, and "visualizations" is left unexplained relative to the what.

4 / 5

Trigger Term Quality

Triggers such as "evaluation criteria", "rubrics", and "visualizations" are natural phrases a user would say. Not a 5 because common synonyms and variations ("custom scoring", "evaluation metrics", "local rubric", "plugin-eval extension") are missing, and "visualizations" appears only in the when-clause without support in the what.

4 / 5

Distinctiveness Conflict Risk

"Design custom metric packs for plugin-eval" carves out a clear niche with distinct triggers ("evaluation criteria", "visualizations", plugin-eval itself) that no generic skill would claim. The anchor-4 concern (overlap with closely related skills) doesn't apply since the target tool is named explicitly.

5 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

openai/plugins

Path

plugins/plugin-eval/skills/metric-pack-designer/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.