CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

derive-review-rubrics

Derive custom review-plugin judges, rubrics, and scoring criteria from evidence — existing skills, PR review feedback, and accumulated agent logs — by finding where agents needed correction or skills failed to activate, then translating those patterns into scoring dimensions and anchors. Hands the rubric design to create-review-plugin for scaffolding. Use when the user wants a custom skill reviewer or scoring rubric grounded in how their agents actually behave — to grade skills consistently, or build review criteria from past PR feedback and agent logs.

1.31x
Quality

100%

Does it follow best practices?

Impact

95%

1.31x

Average score across 6 eval scenarios

SecuritybySnyk

Low

Low-risk findings worth noting

The canonical home for this skill is tessl/review-plugin-creator

SKILL.md
Quality
Evals
Security

Quality

Content

100%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a tight, fully actionable three-step workflow with exact commands, explicit edge-case recovery loops, and a single well-placed one-level-deep reference whose detail genuinely belongs there. It respects token budget, delegates scaffolding and validation cleanly, and states its own scope boundary ("Gather, map, and hand off"). No dimension shows a real weakness.

DimensionReasoningScore

Conciseness

The ~43-line body is lean and dense with no padding and no explanation of concepts Claude already knows; even harness-specific facts Claude would not know ("Claude Code expands skill slash commands inline rather than as a tool call") earn their tokens. It matches the score-5 anchor (lean, efficient, every token earns its place) rather than 4 — the long Stream B paragraph is not over-explanation but a compressed set of distinct edge-case rules, each load-bearing; and it is clearly not 2–3, which require unnecessary explanation or padding.

5 / 5

Actionability

Guidance is fully concrete and executable for an instruction-only skill: the exact command "tessl agent-logs view --json --since <ISO timestamp>" with its provider flags and covered providers, the invocation forms to detect (a tool_use block named Skill with input.skill, or a user message starting with /<skill>), the improvement-types file path, and a specific handoff procedure (write design to a workspace file, then invoke /create-review-plugin). Per the scoring notes, absence of code is not penalized when guidance is this actionable; this matches the score-5 anchor rather than 4 because there are no gaps in the common-case instructions.

5 / 5

Workflow Clarity

The three-step sequence (gather evidence via two streams → map evidence to rubric content → hand off) is clearly ordered, with explicit edge-case handling and feedback loops: empty entries triggers a defined fallback ("say so, proceed on Stream A alone, and skip the two signals below"), empty content triggers recovery ("widen the window rather than treating it as no history"), and non-activation counting is guarded ("Count this only when the skill genuinely should have fired"). No destructive or batch operation is performed, so no validation cap applies, and validation of the artifact is explicitly delegated to create-review-plugin's tessl review run. Matches the score-5 anchor with explicit checkpoints and error-recovery loops; not 4, since no checkpoint within the skill's scope is missing.

5 / 5

Progressive Disclosure

The body is a well-organized overview (Input, Step 1, Step 2, Step 3) with exactly one clearly signaled, one-level-deep reference — [references/evidence-to-rubric.md](references/evidence-to-rubric.md), which exists and holds the appropriately deferred detail (the evidence-to-rubric mapping table, content-judge extra fields, weight rules) while the body keeps only the summary bullets. This matches the score-5 anchor (clear overview, well-signaled one-level references, appropriate split); it is not 4 because there are no organization gaps, and not 3 because nothing that belongs in a separate file is inlined.

5 / 5

Total

20

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is exemplary: concrete third-person actions, named evidence sources, an explicit "Use when" clause with natural trigger phrases, and a clearly bounded niche with the create-review-plugin handoff. It satisfies every judging guideline — no fluff, no over-claims, no verbosity.

DimensionReasoningScore

Specificity

Multiple concrete actions are named — "Derive custom review-plugin judges, rubrics, and scoring criteria from evidence", "finding where agents needed correction or skills failed to activate", "translating those patterns into scoring dimensions and anchors", "Hands the rubric design to create-review-plugin for scaffolding" — with named inputs (existing skills, PR review feedback, agent logs). This matches the score-5 anchor (multiple specific concrete actions, comprehensive coverage); it is not 4 because there is no noticeable gap in what-it-does coverage, and not below because no action is generic or abstract. Third-person voice throughout ("Derives", "Hands"), so no voice penalty.

5 / 5

Completeness

Both what and when are explicitly answered: the what is the derive-and-hand-off pipeline; the when is an explicit "Use when the user wants a custom skill reviewer or scoring rubric grounded in how their agents actually behave — to grade skills consistently, or build review criteria from past PR feedback and agent logs" with concrete trigger phrases. Exact match to the score-5 anchor; a 4 would require the when-clause to be less explicit or specific, which it is not.

5 / 5

Trigger Term Quality

Natural user phrasings are comprehensively covered with synonyms: "custom skill reviewer", "scoring rubric", "grade skills consistently", "build review criteria from past PR feedback and agent logs". A user asking for any of these would plausibly say these exact terms. It matches the score-5 anchor (comprehensive natural terms including synonyms); it is not 4 because no common variation of the request is missing, and not below because the terms are specific rather than generic.

5 / 5

Distinctiveness Conflict Risk

A clear niche — deriving evidence-grounded rubrics from skills, PR feedback, and agent logs — with distinct triggers, and the handoff sentence ("Hands the rubric design to create-review-plugin for scaffolding") explicitly separates it from the sibling scaffolding skill. Minimal conflict risk, matching the score-5 anchor; it is not 4 because the overlap with create-review-plugin is addressed by stating the boundary rather than left as a minor risk.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

tesslio/product-plugins

Path

review-plugin-creator/skills/derive-review-rubrics/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.