CtrlK
BlogDocsLog inGet started
Tessl Logo

reproduce-benchmark

Reproduce and verify the benchmark claims of a tool or paper already triaged in the research repo. Locates the benchmark harness, runs it, and records verified vs. reported figures in benchmarks/sources/{slug}-repro.md. Triggers: reproduce benchmark, verify claims, run benchmark, check benchmark, benchmark reproduction, verify numbers.

71

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

The canonical home for this skill is reproduce-benchmark in pantheon-org/tekhne

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-crafted instruction skill: concrete executable commands, a disciplined verification mindset with explicit anti-patterns, and proper use of a real bundle for template/schema/validator details. The two residual gaps are minor: slight padding in the MCP-config and Mindset sections, and no explicit re-validation loop after the final validator run.

Suggestions

Add a short 'if the validator fails, fix the flagged fields and re-run' loop to step 9 to close the last workflow gap.

Trim the MCP server JSON block to the two command lines (or defer to triage-paper immediately) to tighten the mid-section.

Compress the Mindset bullets into the workflow steps they govern to remove the remaining motivational padding.

DimensionReasoningScore

Conciseness

The body is efficient — short imperative sections, no re-teaching of concepts Claude already knows, concrete file paths throughout — but the full MCP server JSON block and the 'Mindset' section contain minor padding that could be trimmed, matching the 'minor instances of over-explanation' anchor rather than the every-token-earns-its-place anchor.

4 / 5

Actionability

Quick Commands are copy-paste-ready ('./scripts/validate-repro-benchmark.sh benchmarks/sources/<slug>-repro.md', 'npm run benchmark 2>&1 | tee /tmp/<slug>-benchmark-out.txt'), step 7 points to a real template with required_fields, and step 6 gives concrete categorization rules with a ±10% tolerance — fully executable guidance covering the common cases.

5 / 5

Workflow Clarity

The 9-step workflow is clearly sequenced with real checkpoints — existing-repro check (step 2), explicit harness-failure handling (step 5), metric categorization (step 6), and a final validation run (step 9) — but it stops short of an explicit fix-and-re-validate loop if the step-9 validator fails, the minor validation gap that distinguishes anchor 4 from anchor 5.

4 / 5

Progressive Disclosure

The template structure, schema, and validator are correctly externalized to real bundle files (assets/templates/REPRO-benchmark.yaml, assets/schemas/repro-benchmark.schema.json, scripts/validate-repro-benchmark.sh), referenced inline at the point of use and again in a clearly labeled References section, all one level deep — matching the clear-overview, well-signaled-references anchor.

5 / 5

Total

18

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete multi-action capability statement, explicit third-person voice, an explicit trigger clause with natural phrases, and a clearly bounded niche. The only weakness is that the trigger list misses a few natural synonyms such as 'verify results' or 'replicate'.

Suggestions

Add one or two natural trigger synonyms such as 'verify results' or 'replicate benchmark results' to broaden the trigger list.

Consider mentioning paper/tool results explicitly (e.g. 'reproduce reported metrics') so paper-oriented phrasings also match.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions — 'Locates the benchmark harness, runs it, and records verified vs. reported figures in benchmarks/sources/{slug}-repro.md' — covering the full workflow with no real gaps in capability coverage, matching the comprehensive-actions anchor rather than the 'minor gaps' anchor at 4.

5 / 5

Completeness

It clearly answers both what ('Reproduce and verify the benchmark claims of a tool or paper already triaged in the research repo') and when, with an explicit Triggers clause containing concrete trigger phrases — the exact pattern of the top anchor.

5 / 5

Trigger Term Quality

'Triggers: reproduce benchmark, verify claims, run benchmark, check benchmark, benchmark reproduction, verify numbers' provides good natural-phrase coverage with a variation ('benchmark reproduction'), but common synonyms like 'verify results' or 'replicate results' are missing, so it falls just short of the comprehensive anchor.

4 / 5

Distinctiveness Conflict Risk

The niche is clear (benchmark reproduction of already-triaged tools/papers in this research repo) with trigger terms distinct from the companion triage skills, giving minimal conflict risk; it does not trigger on generic requests.

5 / 5

Total

19

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

relative_links

Relative link issues: 2 deeper-than-1-level, 1 suspicious

Warning

referenced_paths_exist

Referenced path issues: 3 deeper-than-1-level

Warning

Total

13

/

16

Passed

Repository
pantheon-org/tekhne
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.