CtrlK
BlogDocsLog inGet started
Tessl Logo

slime-rl-training

Provides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data generation workflows, or needing tight Megatron-LM integration for RL scaling.

58

Quality

70%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./optional-skills/mlops/slime/SKILL.md

The canonical home for this skill is slime-rl-training in Orchestra-Research/AI-Research-SKILLs

SKILL.md
Quality
Evals
Security

Quality

Content

65%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable with concrete, executable commands and code, and is reasonably well organized. Its weaknesses are verbosity from content duplicated with the reference files, missing validation feedback loops in the batch-training workflows, and reference files that exist but are never linked from the overview.

Suggestions

Replace the inline Architecture Overview and Common Issues and Solutions sections with one-level-deep links to references/api-reference.md and references/troubleshooting.md to remove duplication and make the bundle references discoverable.

Add explicit validate-then-proceed checkpoints to Workflow 1 (e.g. after Step 3, 'confirm reward curves are increasing and no OOM before continuing; if not, apply the fixes in the troubleshooting reference and relaunch').

Tighten the Configuration Reference and Advanced Topics sections to the flags most users need, moving exhaustive option listings into the API reference file to reduce the body's token footprint.

DimensionReasoningScore

Conciseness

The body is largely domain-specific slime content rather than concepts Claude already knows, but at ~450 lines it is long and duplicates material that also lives in the bundle: the Architecture Overview diagram and the Common Issues and Solutions section reappear in references/api-reference.md and references/troubleshooting.md respectively, so it is 'mostly efficient but could be tightened'.

2 / 3

Actionability

It provides fully executable, copy-paste-ready guidance: complete 'python train.py ...' invocations with concrete flags, real Python in custom_generate.py and custom_rm.py, and exact JSONL data formats, matching 'fully executable code/commands; specific examples'.

3 / 3

Workflow Clarity

Workflows 1-3 are sequenced with numbered steps and prerequisite/monitoring checklists, but they lack explicit validate-then-proceed feedback loops for the batch training operation (e.g. 'if reward curves are not increasing, adjust and restart'); the rubric caps batch-operation workflows at 2 when verification checkpoints are missing.

2 / 3

Progressive Disclosure

The body is well sectioned and not deeply nested, but the two existing bundle files (references/api-reference.md, references/troubleshooting.md) are never linked or signaled from the body, and content that belongs in them (architecture overview, troubleshooting) is duplicated inline, fitting 'references present but not clearly signaled; content that should be separate is inline'.

2 / 3

Total

9

/

12

Passed

Description

75%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is well-formed with a clear what/when structure, explicit triggers, third-person voice, and a distinct niche. It is held back from perfection only by slightly abstract lead wording and jargon-heavy trigger terms that miss a few common variations.

DimensionReasoningScore

Specificity

It names the domain and several actions ('training GLM models, implementing custom data generation workflows, needing tight Megatron-LM integration for RL scaling'), but the lead verb 'Provides guidance' is abstract rather than a concrete capability, so it lands at 'names domain and some actions, not comprehensive' rather than listing multiple specific concrete actions.

2 / 3

Completeness

It explicitly answers both 'what' ('Provides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework') and 'when' with an explicit 'Use when training GLM models, implementing custom data generation workflows, or needing tight Megatron-LM integration for RL scaling' trigger clause, matching the anchor for clearly answering both what AND when.

3 / 3

Trigger Term Quality

Relevant terms appear ('LLM post-training with RL', 'training GLM models', 'custom data generation workflows'), but the phrasing leans technical ('Megatron+SGLang framework', 'Megatron-LM integration for RL scaling') and omits common natural variations a user might say (e.g. RLHF, GRPO, fine-tuning), so it has 'some relevant keywords but missing common variations'.

2 / 3

Distinctiveness Conflict Risk

The GLM + Megatron-LM + SGLang RL post-training niche is specific and the triggers (training GLM models, Megatron-LM integration) are distinct, making it unlikely to fire for an unrelated skill.

3 / 3

Total

10

/

12

Passed

Validation

75%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation12 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

referenced_paths_exist

Referenced path issues: 4 missing, 2 deeper-than-1-level

Warning

Total

12

/

16

Passed

Repository
NousResearch/hermes-agent
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.