CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

reproduce-benchmark

Reproduce and verify the benchmark claims of a tool or paper already triaged in the research repo. Locates the benchmark harness, runs it, and records verified vs. reported figures in benchmarks/sources/{slug}-repro.md. Triggers: reproduce benchmark, verify claims, run benchmark, check benchmark, benchmark reproduction, verify numbers.

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-built skill body: concrete commands, honest-reporting mindset codified in anti-patterns, template-driven output, and clean one-level-deep references. The two small gaps are mild duplication (MCP JSON block, Quick Commands) and the absence of an explicit recovery loop after validation fails.

Suggestions

Replace the inline MCP server JSON block with a one-line pointer to the setup guidance in triage-paper, keeping the body lean.

Add a fix-and-re-validate loop to step 9: "If the validator reports errors, fix the frontmatter/sections and re-run it before reporting."

Trim the Quick Commands section to only commands not already shown in the workflow, or cut it entirely since steps 4, 5, and 9 already contain them.

DimensionReasoningScore

Conciseness

The body is largely efficient — no re-teaching of concepts Claude knows, and the anti-patterns are terse and purposeful. Minor trim candidates remain: the 16-line MCP server JSON block (which duplicates another skill's setup, already deferred via "See triage-paper for full setup guidance") and the "Quick Commands" section repeating steps 4, 5, and 9 of the workflow.

4 / 5

Actionability

Guidance is fully executable: copy-paste commands with sensible placeholders ("./scripts/validate-repro-benchmark.sh benchmarks/sources/<slug>-repro.md", "npm run benchmark 2>&1 | tee /tmp/<slug>-benchmark-out.txt"), a concrete tolerance rule ("reproduced within ±10% of reported value"), an outcome value table, and template-driven file creation via the YAML template. The common cases are covered end-to-end.

5 / 5

Workflow Clarity

The 9-step sequence is clearly ordered with real checkpoints (existing-repro check before running, harness failure → outcome `failed`, a validator run in step 9). However, there is no explicit fix-and-re-validate feedback loop after step 9 — what to do when the validator reports errors is left implicit, which is the minor validation gap that distinguishes this from the top anchor.

4 / 5

Progressive Disclosure

The body is a well-organized overview with a references table giving per-entry "When to Use" guidance, and all four referenced bundle files (references/repro-file-guide.md, assets/templates/REPRO-benchmark.yaml, assets/schemas/repro-benchmark.schema.json, scripts/validate-repro-benchmark.sh) exist and are exactly one level deep, with the reference guide not chaining further. Structure and navigation are easy to follow.

5 / 5

Total

18

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete actions, an explicit trigger clause, third-person voice, and a distinct niche. The only weakness is that the trigger list could add a few more natural variations users would say.

Suggestions

Add one or two natural trigger variations such as "reproduce results" or "verify reported metrics" to broaden the keyword coverage.

Consider mentioning what happens when a benchmark cannot be run (e.g. "marks outcomes verified/unverified/failed") to sharpen the capability picture.

DimensionReasoningScore

Specificity

"Locates the benchmark harness, runs it, and records verified vs. reported figures in benchmarks/sources/{slug}-repro.md" lists multiple concrete actions with a specific output location, comprehensively covering the skill's domain. There are no meaningful coverage gaps that would place it at the anchor below.

5 / 5

Completeness

The description explicitly answers both what ("Reproduce and verify the benchmark claims... Locates the benchmark harness, runs it, and records verified vs. reported figures") and when ("Triggers: reproduce benchmark, verify claims, ..." plus "already triaged in the research repo"), matching the anchor for explicit what-and-when with concrete trigger phrases.

5 / 5

Trigger Term Quality

"Triggers: reproduce benchmark, verify claims, run benchmark, check benchmark, benchmark reproduction, verify numbers" provides good natural-phrase coverage including a synonym variation ("benchmark reproduction"). A few natural terms users might say are missing (e.g. "reproduce results", "verify metrics/reported numbers"), so it falls just short of comprehensive.

4 / 5

Distinctiveness Conflict Risk

It carves out a clear niche (benchmark reproduction for tools/papers already triaged in the research repo) with distinct trigger phrases; it is unlikely to fire for unrelated skills and conflicts with nothing generic.

5 / 5

Total

19

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

relative_links

Relative link issues: 2 deeper-than-1-level, 1 suspicious

Warning

referenced_paths_exist

Referenced path issues: 3 deeper-than-1-level

Warning

Total

13

/

16

Passed

Repository

pantheon-org/tekhne

Path

skills/documentation/research/reproduce-benchmark/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.