CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

benchmark-checklist

Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened) before you report or act on it. Use when you run a benchmark or report a speedup or regression you measured.

74

Quality

93%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is benchmark-checklist in cursor/plugins

SKILL.md
Quality
Evals
Security

Quality

Content

96%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

Excellent instructional content: maximally dense, concrete, and sequenced, with quantitative rules, named tools, explicit inconclusive criteria, and feedback loops throughout. The only gap is the three dangling playbook cross-references that assume external material the bundle does not ship.

Suggestions

Give the three playbook references a location (path or link) — e.g. 'per the **Opening a PR** playbook (playbooks/opening-a-pr.md)' — or inline the one rule being relied on so the skill stands alone.

The Hillclimb sentence ('The frozen harness then prints error and work counts...') only makes sense if the reader knows that playbook; add one clause stating the contract ('check the printed counts against questions 4 and 7') so it survives without the companion document.

DimensionReasoningScore

Conciseness

The body is lean and dense: every sentence instructs ("Profile in a run you do not report, because profilers and tracers slow the work down", "Run each side at least 5 times, alternating"). It names concrete tools inline (`top`, `pidstat`, `py-spy`, `perf`, `strace -c`, `uptime`, `nproc`) without explaining what they are, and never explains concepts Claude already knows. Matches the 5-anchor 'lean and efficient; every token earns its place'.

5 / 5

Actionability

For an instruction-only skill the guidance is fully executable: specific commands per limiter type ("node --cpu-prof", "py-spy", "strace -c on Linux"), quantitative decision rules ("at least 5 times, alternating", "A gap smaller than the run-to-run variation is no measurable difference", "Removing a piece that takes 10% of the run can make the run at most about 11% faster"), and a copy-ready report sentence. Matches the 5-anchor 'fully executable; specific examples cover the common cases'.

5 / 5

Workflow Clarity

The sequence is explicit: pre-run steps (write the claim, read the script, check load), the seven numbered validation questions, then a report section with explicit inconclusive criteria and fallback behavior ("If you cannot tune it, do not pick a winner from that run"). The questions are themselves validation checkpoints with error-recovery feedback loops (profile → retune → re-measure), and a fast path for ballpark requests is defined. Matches the 5-anchor 'clear sequence with explicit validation steps; feedback loops'.

5 / 5

Progressive Disclosure

The skill is under 50 lines, self-contained, and well-sectioned (Before you run anything / The questions / Report / Other perf material), so by the simple-skill note it approaches 5. It drops to 4 because 'Report' and 'Other perf material' depend on external material — "per the **Opening a PR** playbook", "the **Perf issue** playbook", "the **Hillclimb** playbook" — with no paths or links, and no bundle files exist to resolve them; that is a minor navigation gap, matching the 4-anchor 'references mostly clear; minor organization gaps' rather than the 5-anchor's well-signaled references.

4 / 5

Total

19

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, terse, with an explicit 'Use when' trigger clause and a concrete parenthetical inventory of what gets vetted. Its only weakness is keyword breadth — a few natural synonyms (e.g., "performance test", "throughput", "microbenchmark") are absent, and the capability inventory could name the verification actions themselves rather than just the dimensions.

Suggestions

Add one or two natural trigger synonyms (e.g., 'performance test', 'throughput', 'microbenchmark') so the description fires on the phrasings users actually type.

Make the 'what' fully action-shaped (e.g., 'Vet a perf measurement — name the limiter, check tuning, do the limits arithmetic, count errors, rerun for repeatability — before you report it') so the capability list reads as concrete actions rather than topic labels.

DimensionReasoningScore

Specificity

The description enumerates concrete vetting dimensions — "(limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened)" — which is several specific facets of the single action "Vet a perf measurement ... before you report or act on it". It lists several specific actions/aspects with minor gaps (e.g., no mention of what to do with the verdict), matching the anchor 'Lists several specific actions; minor gaps' rather than the fully comprehensive 5-anchor's battery of distinct actions.

4 / 5

Completeness

Both halves are explicit and concrete: what — "Vet a perf measurement (limiter, tuning, limits, errors, repeatability, relevance, and whether the work happened)" — and when — "Use when you run a benchmark or report a speedup or regression you measured." This matches the 5-anchor 'clearly and explicitly answers both what AND when with concrete trigger phrases'; the 4-anchor ('when' could be more explicit) does not apply since the trigger clause is specific.

5 / 5

Trigger Term Quality

Natural user phrases are present: "run a benchmark", "report a speedup or regression you measured", "perf measurement". These are the words a user would naturally say when needing this skill. It is not the 5-anchor's comprehensive coverage with synonyms — common variations like "performance test", "throughput", "latency numbers", or "microbenchmark" are missing.

4 / 5

Distinctiveness Conflict Risk

It occupies a clear niche — vetting self-produced performance measurements before reporting — with distinct triggers (benchmark runs, speedup/regression claims) that would not fire for general perf-tuning, profiling, or code-review skills. Minimal conflict risk; matches the 5-anchor 'clear niche with distinct triggers'.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

cursor/plugins

Path

harness/pstack/claude-code/skills/benchmark-checklist/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.