CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

experiment-queue

SSH job queue for multi-seed/multi-config ML experiments with OOM-aware retry, stale-screen cleanup, and wave-transition race prevention. Use when user says "batch experiments", "队列实验", "run grid", "multi-seed sweep", "auto-chain experiments", or when /run-experiment is insufficient for 10+ jobs that need orchestration.

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

Highly actionable content with an exemplary validated workflow for a batch-orchestration skill — executable commands, explicit pre-flight gates, and robust failure/recovery loops throughout. The main weakness is token efficiency: duplicated guidance across three sections and internal migration/history notes that could be consolidated or removed.

Suggestions

Consolidate the "When to Use", "Comparison with /run-experiment" table, and the trailing "Rule" line into one section — the ≤5 vs ≥10 job guidance is currently stated three times.

Merge "Why This Exists" and "Rationale / Source" into a single short rationale; the dated 2026-04-16 audit narrative and wall-clock/token/cognitive sink lists largely repeat each other.

Move the "Phase 3.3 (Arch C)" migration history and legacy "os.execv shim" details out of the main workflow (e.g., a brief "Deprecated paths" note) so the launch instructions stay lean.

DimensionReasoningScore

Conciseness

The body is mostly dense and earning its place, but includes unnecessary duplication and padding: the ≤5 vs ≥10 jobs rule is stated three times ("When to Use", the "Comparison with /run-experiment" table, and the "Rule" line), "Why This Exists" repeats "Rationale / Source", and internal migration/date-stamped details ("Phase 3.3 (Arch C)", "os.execv shims", the 2026-04-16 session audit) inflate the token budget without guiding execution. It is above the noticeably-verbose anchor (2) but has clear tightening opportunities.

3 / 5

Actionability

Guidance is fully executable: real bash for binding run identifiers (`PROJECT_DIR="${PROJECT_DIR:?...}"`), ARIS_REPO resolution with explicit error branches, scp/nohup launch commands, `%q`-escaped run_meta persistence, a jq one-liner for status rollup, concrete YAML manifest/grid/phase syntax, and the exact OOM regex `torch\.OutOfMemoryError: CUDA out of memory`. Common cases are covered with copy-paste-ready commands, with placeholders clearly flagged.

5 / 5

Workflow Clarity

The five-step workflow (Parse → Pre-flight → Launch → Monitoring → Post-completion) is clearly sequenced with explicit validation checkpoints: pre-flight gates (SSH, conda env, cwd, preconditions, GPU availability), expected-output-based completion verification, a bounded OOM detect→kill→delay→requeue feedback loop, stale-screen re-evaluation, wave-settlement conditions, and idempotent resume-on-restart. Batch-operation validation is present, so no cap applies.

5 / 5

Progressive Disclosure

Good structure with clear section headers and well-signaled one-level-deep references (`../shared-references/compute-env-contract.md`, `../shared-references/external-cadence.md`, canonical script paths in See Also); no bundle files exist to nest. It falls short of 5 because scheduler internals, the comparison table, and the rationale narrative are inlined in a ~400-line SKILL.md where some content (e.g., legacy-shim migration notes) could be split out or dropped.

4 / 5

Total

17

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete capabilities, an explicit 'Use when' clause with natural (and bilingual) trigger phrases, and a clear boundary against /run-experiment. The only room for improvement is slightly broader capability coverage and a few more trigger synonyms.

DimensionReasoningScore

Specificity

The description lists several concrete actions — "SSH job queue for multi-seed/multi-config ML experiments with OOM-aware retry, stale-screen cleanup, and wave-transition race prevention" — naming the domain plus four specific capabilities. It falls short of a 5 because capabilities like grid/manifest building, state persistence, and resume-on-crash are absent, leaving minor gaps in coverage.

4 / 5

Completeness

It explicitly answers both questions: the first sentence states what the skill does (SSH job queue with OOM-aware retry, stale-screen cleanup, wave-transition race prevention) and the "Use when user says..." clause gives concrete trigger phrases plus an explicit insufficiency condition for the sibling skill. This matches the anchor for a clear, explicit what-and-when with concrete triggers.

5 / 5

Trigger Term Quality

Strong natural trigger phrases — "batch experiments", "队列实验", "run grid", "multi-seed sweep", "auto-chain experiments" — including a bilingual synonym and an actionable threshold ("when /run-experiment is insufficient for 10+ jobs"). A few natural variations are missing (e.g., "hyperparameter sweep", "queue experiments", "run experiments in parallel"), so it does not reach comprehensive coverage.

4 / 5

Distinctiveness Conflict Risk

The niche is clear — SSH-based orchestration of large ML experiment batches on GPU servers — and the trigger "when /run-experiment is insufficient for 10+ jobs that need orchestration" explicitly draws the boundary against the closest sibling skill, minimizing wrong-skill triggering.

5 / 5

Total

18

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 1 suspicious

Warning

Total

13

/

16

Passed

Repository

wanshuiyin/Auto-claude-code-research-in-sleep

Path

skills/skills-codex/experiment-queue/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.