CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

experiment-plan

Turn a refined research proposal or method idea into a detailed, claim-driven experiment roadmap. Use after `research-refine`, or when the user asks for a detailed experiment plan, ablation matrix, evaluation protocol, run order, compute budget, or paper-ready validation that supports the core problem, novelty, simplicity, and any LLM / VLM / Diffusion / RL-based contribution.

Quality

81%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Critical

Do not install without reviewing

SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-sequenced, highly actionable planning skill with explicit decision gates, checklists, and copy-paste output templates, and no filler. The structural weakness is disclosure: it is a monolithic ~250-line body whose output templates are inlined, and its only external references point to shared files outside the bundle that don't resolve.

Suggestions

Move the EXPERIMENT_PLAN.md and EXPERIMENT_TRACKER.md output templates into a references/ file (e.g. references/plan-template.md) and keep a short summary inline, so SKILL.md stays a lean overview.

Resolve the ../shared-references/output-*.md links: either vendor the needed protocol content into the skill's own references/ directory or inline a one-line summary of each protocol, since the linked paths do not exist relative to this bundle.

For Phase 4's compute cost and turnaround estimates, give a concrete heuristic or unit convention (e.g. GPU-hours per run and a per-milestone budget table) so the estimates are reproducible rather than open-ended.

DimensionReasoningScore

Conciseness

The body is dense and prescriptive with no explanations of concepts Claude already knows, and constants (MAX_PRIMARY_CLAIMS, DEFAULT_SEEDS) economically bound the design. Minor trimming is possible: the per-block field list in Phase 3 repeats the template fields in Step 5.1, and the "Composing with Other Skills" section duplicates information already implied by the description.

4 / 5

Actionability

Phases 0-5 give concrete, executable instructions, and both output files get full copy-paste-ready markdown templates (Claim Map table, Block fields, milestone table, tracker schema). Minor gaps remain: "estimate compute cost" and "expected turnaround time" are requested of the model without any concrete estimation method or units.

4 / 5

Workflow Clarity

The sequence (Phase 0 load -> 1 freeze claims -> 2 storyline -> 3 specify blocks -> 4 run order -> 5 write outputs) is explicit, and validation is built in: the sanity milestone ("metric correctness, one quick overfit"), stop/go decision gates per milestone, per-block success criterion and failure interpretation, and a Final Checklist. The plan is paper-only (no destructive/batch operations), so no feedback-loop cap applies.

5 / 5

Progressive Disclosure

The SKILL.md is ~250 lines with the two large output templates inlined; no references/, scripts/, or assets/ bundle exists, so everything lives in the body. The Output Protocols section links to ../shared-references/output-versioning.md, output-manifest.md, and output-language.md — paths outside this skill's directory that do not resolve here, so navigation to those protocols cannot be verified and the templates that could sit in reference files are inline.

3 / 5

Total

16

/

20

Passed

Description

78%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with an explicit, multi-trigger 'when' clause and natural keywords that users would plausibly say. Its main weakness is that the capability statement compresses everything into a single transformation action, with the richer specifics living only in the trigger list.

DimensionReasoningScore

Specificity

The 'what' is one concrete action — "Turn a refined research proposal or method idea into a detailed, claim-driven experiment roadmap" — which names the domain and the core transformation but does not list several distinct actions. The additional capabilities ("ablation matrix, evaluation protocol, run order, compute budget, paper-ready validation") appear in the when-clause as triggers rather than as stated capabilities, so this sits between the 1-2-action anchor and the several-actions anchor.

3 / 5

Completeness

Both questions are explicitly answered: what — turning a refined proposal into a claim-driven experiment roadmap; when — "Use after `research-refine`, or when the user asks for a detailed experiment plan, ablation matrix, evaluation protocol, run order, compute budget..." with concrete trigger phrases. The 'when' is explicit and multi-trigger, matching the top anchor.

5 / 5

Trigger Term Quality

Strong natural phrases a user would actually say: "detailed experiment plan, ablation matrix, evaluation protocol, run order, compute budget", plus an explicit pipeline trigger "Use after `research-refine`". A few common variations (e.g. "experiment design", "baselines", "evaluation plan") are missing, keeping it just below comprehensive.

4 / 5

Distinctiveness Conflict Risk

The experiment-planning niche (ablation matrix, run order, compute budget) is clearly distinguishable from generic research or writing skills, and "Use after `research-refine`" explicitly orders it against its sibling skill. Minor overlap risk remains with closely related pipeline skills (/research-refine, /run-experiment) whose requests could partially match.

4 / 5

Total

16

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

relative_links

Relative link issues: 3 suspicious

Warning

Total

14

/

16

Passed

Repository

wanshuiyin/Auto-claude-code-research-in-sleep

Path

skills/experiment-plan/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.