CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

experiment-plan

Turn a refined research proposal or method idea into a detailed, claim-driven experiment roadmap. Use after `research-refine`, or when the user asks for a detailed experiment plan, ablation matrix, evaluation protocol, run order, compute budget, or paper-ready validation that supports the core problem, novelty, simplicity, and any LLM / VLM / Diffusion / RL-based contribution.

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Critical

Do not install without reviewing

SKILL.md
Quality
Evals
Security

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable planning skill with a clear phased workflow and concrete output templates. The main weaknesses are minor redundancy between the Key Rules and the phase instructions, and output protocols that reference shared files which do not exist in the bundle.

Suggestions

Fix or inline the Output Protocols section: the three ../../shared-references/*.md links do not resolve within this skill's bundle — either ship the protocol content inside SKILL.md (the protocols are short enough) or include the shared-references files in the bundle.

Consolidate the 'must-run vs nice-to-have' and 'strong baselines over long lists' guidance: it appears in Phase 2, Phase 4, and Key Rules; stating it once (e.g., in Key Rules) would trim roughly 10-15 lines.

Consider moving the full EXPERIMENT_PLAN.md template into a references/ file (e.g. references/plan-template.md) and keeping only the claim map and block skeleton inline, which would reduce the always-loaded SKILL.md footprint while keeping the workflow actionable.

DimensionReasoningScore

Conciseness

The body is dense and assumes domain competence — no space is spent explaining concepts Claude already knows — but Key Rules and the must-run/nice-to-have guidance partially repeat what Phases 2–4 already specify, so a small amount could be trimmed. Not 5 because of that redundancy; not 3 because the padding is minor and the templates earn their tokens.

4 / 5

Actionability

Guidance is fully executable: named input files to read, concrete constants (MAX_PRIMARY_CLAIMS, DEFAULT_SEEDS), copy-ready markdown templates for EXPERIMENT_PLAN.md and EXPERIMENT_TRACKER.md, and an exact summary message format to present to the user.

5 / 5

Workflow Clarity

Phases 0–5 are clearly sequenced with an explicit fallback ('If these files do not exist, derive the same information from the user's prompt'), stop/go decision gates per milestone, a sanity stage, a final checklist, and an error-recovery loop for Write-tool failures.

5 / 5

Progressive Disclosure

The single-file body is well organized into clear sections, but the only external references — ../../shared-references/output-versioning.md, output-manifest.md, and output-language.md — do not resolve anywhere in the bundle, and no references/, scripts/, or assets/ files exist, so the links are dangling and cannot be navigated. Not 4 because the referenced content is unverifiable; not 2 because the body structure itself is appropriately organized for a single-file skill.

3 / 5

Total

17

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with an explicit what/when structure and natural, domain-accurate trigger terms. The only weakness is slight overlap with the closely related research-refine pipeline skills and a somewhat broad qualifying clause.

DimensionReasoningScore

Specificity

The description lists multiple concrete deliverables — 'claim-driven experiment roadmap', 'ablation matrix', 'evaluation protocol', 'run order', 'compute budget', 'paper-ready validation' — giving comprehensive coverage of the domain's outputs rather than minor-gap coverage.

5 / 5

Completeness

It explicitly answers both: 'Turn a refined research proposal or method idea into a detailed, claim-driven experiment roadmap' (what) and 'Use after research-refine, or when the user asks for...' (when, with concrete trigger phrases).

5 / 5

Trigger Term Quality

Phrases like 'detailed experiment plan', 'ablation matrix', 'evaluation protocol', 'run order', and 'compute budget' are exactly what a researcher would naturally say when they need this skill, with good synonym coverage.

5 / 5

Distinctiveness Conflict Risk

The niche is clear and triggers like 'ablation matrix' and 'run order' distinguish it from general research refinement, but it sits in a closely related pipeline family (research-refine, run-experiment) and the broad tail clause about 'any LLM / VLM / Diffusion / RL-based contribution' creates minor overlap risk with sibling skills.

4 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 3 suspicious

Warning

Total

15

/

16

Passed

Repository

wanshuiyin/Auto-claude-code-research-in-sleep

Path

skills/skills-codex/experiment-plan/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.