CtrlK
BlogDocsLog inGet started
Tessl Logo

experiment-queue

SSH job queue for multi-seed/multi-config ML experiments with OOM-aware retry, stale-screen cleanup, and wave-transition race prevention. Use when user says "batch experiments", "队列实验", "run grid", "multi-seed sweep", "auto-chain experiments", or when /run-experiment is insufficient for 10+ jobs that need orchestration.

71

Quality

88%

Does it follow best practices?

Impact

No eval scenarios have been run

SecuritybySnyk

Passed

No known issues

SKILL.md
Quality
Evals
Security

Quality

Discovery

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

This is an excellent skill description that clearly defines a specific niche (SSH-based ML experiment orchestration), lists concrete capabilities (OOM-aware retry, stale-screen cleanup, wave-transition race prevention), and provides explicit trigger terms in both English and Chinese. The explicit boundary with '/run-experiment' for 10+ jobs further reduces ambiguity and conflict risk.

DimensionReasoningScore

Specificity

Lists multiple specific concrete actions: SSH job queue, multi-seed/multi-config ML experiments, OOM-aware retry, stale-screen cleanup, and wave-transition race prevention. These are highly specific capabilities.

3 / 3

Completeness

Clearly answers both 'what' (SSH job queue for ML experiments with OOM retry, cleanup, race prevention) and 'when' (explicit 'Use when' clause with specific trigger phrases and a clear threshold of 10+ jobs needing orchestration).

3 / 3

Trigger Term Quality

Excellent coverage of natural trigger terms including 'batch experiments', '队列实验' (Chinese), 'run grid', 'multi-seed sweep', 'auto-chain experiments', and even references the boundary with '/run-experiment' for 10+ jobs. These are terms users would naturally say.

3 / 3

Distinctiveness Conflict Risk

Highly distinctive niche: SSH-based ML experiment orchestration with specific features like OOM-aware retry and wave-transition race prevention. Explicitly distinguishes itself from '/run-experiment' for smaller jobs, reducing conflict risk.

3 / 3

Total

12

/

12

Passed

Implementation

77%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is a highly actionable and well-structured skill for orchestrating ML experiment queues, with excellent workflow clarity including explicit validation checkpoints, error recovery loops, and state machine definitions. Its main weakness is verbosity—the legacy resolver chain explanation, rationale sections, and comparison table inflate the token cost significantly. The content would benefit from splitting reference material into separate files to improve progressive disclosure.

Suggestions

Move the legacy resolver chain details (Step 3a) into a separate RESOLVER.md or TROUBLESHOOTING.md, keeping only the final resolved command in the main skill

Extract the 'Rationale / Source', 'Comparison with /run-experiment', and 'Known Failure Modes' sections into a separate REFERENCE.md to reduce the main skill's token footprint by ~30%

DimensionReasoningScore

Conciseness

The skill is quite long (~350+ lines) and includes some sections that could be trimmed—e.g., the 'Why This Exists' rationale, the 'Rationale / Source' section, the comparison table with /run-experiment, and detailed explanations of legacy shim chains. However, most content is genuinely instructive and not explaining things Claude already knows (it's project-specific orchestration logic). The legacy resolver chain in Step 3a is particularly verbose for what it accomplishes.

2 / 3

Actionability

The skill provides fully executable bash commands, concrete YAML manifest examples, specific regex patterns for OOM detection, jq commands for monitoring, and complete code blocks for every step from manifest creation through launch, monitoring, and resume. The grid spec syntax and wave chaining examples are copy-paste ready with clear variable substitution patterns.

3 / 3

Workflow Clarity

The workflow is clearly sequenced (Steps 1-5) with explicit validation checkpoints: pre-flight checks in Step 2, state machine with clear transitions, wave transition conditions (4 explicit criteria), stale screen detection logic, OOM retry with bounded attempts, and resume-on-restart procedures. The feedback loops for error recovery (OOM → retry, stale → cleanup → requeue) are well-defined with explicit conditions.

3 / 3

Progressive Disclosure

The skill references external scripts (queue_manager.py, build_manifest.py) and other skills (/run-experiment, /monitor-experiment, /analyze-results) appropriately, and the 'See Also' section provides clear navigation. However, the SKILL.md itself is monolithic—sections like the detailed resolver chain, the comparison table, the rationale section, and the known failure modes could be split into separate reference files. No bundle files were provided to verify referenced paths exist.

2 / 3

Total

10

/

12

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation9 / 11 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

9

/

11

Passed

Repository
wanshuiyin/Auto-claude-code-research-in-sleep
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.