CtrlK
BlogDocsLog inGet started
Tessl Logo

accelerate

Run PyTorch training across GPUs with minimal changes.

57

Quality

68%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./optional-skills/mlops/accelerate/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a strong, example-driven skill: executable code for every common distributed-training configuration, clear per-topology launch commands, and well-signaled references that all resolve to real bundle files. Its main weaknesses are mild — the Quick Start/Workflow 1 duplication and a somewhat long main body that could offload more to the reference files.

DimensionReasoningScore

Conciseness

The body is code-heavy and assumes competence (no explanations of what PyTorch or distributed training are), but Workflow 1 substantially duplicates the Quick Start conversion example, and filler comments like "# Everything else is automatic!" and a partly decorative Resources section ("Used by: HuggingFace Transformers, TRL, PEFT...") could be trimmed. This matches anchor 4 (efficient, minor instances that could be trimmed) rather than 5, where every token earns its place.

4 / 5

Actionability

Nearly everything is copy-paste ready: full converted scripts, concrete Accelerator(...) constructor kwargs for fp16/bf16/fp8, DeepSpeedPlugin/FullyShardedDataParallelPlugin instantiations, exact launch commands with flags per topology (--multi_gpu --num_processes 8, --num_machines 2 --machine_rank 0), and effective-batch-size formulas. The common cases (single/multi-GPU, multi-node, mixed precision, DeepSpeed, FSDP, gradient accumulation, checkpointing) are all covered with executable code, matching anchor 5.

5 / 5

Workflow Clarity

Each workflow is clearly sequenced (convert script → interactive config → launch with topology-specific commands) and the Common Issues section provides error-recovery guidance (wrong device placement, accumulation not working, FSDP seed variance). Not 5 because there are no explicit validation checkpoints (e.g. verifying processes launched, checking distributed env); not 3 because sequences are complete and a troubleshooting feedback section exists — anchor 4 fits best.

4 / 5

Progressive Disclosure

The Advanced topics section cleanly signals one-level-deep references — references/megatron-integration.md, references/custom-plugins.md, references/performance.md — all of which exist in the bundle and match their descriptions. The main body itself runs ~350 lines and inlines substantial detail (full DeepSpeed/FSDP workflows, hardware requirements) that could partly live in references, so anchor 4 (good structure, minor organization gaps) fits better than 5.

4 / 5

Total

17

/

20

Passed

Description

53%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concise and concrete about the 'what' but is bare-bones: it lacks any 'when to use' trigger guidance and omits the distributed-training vocabulary (multi-GPU, DDP, DeepSpeed, FSDP) users would naturally say. It would benefit most from an explicit trigger clause and a broader set of natural keywords.

Suggestions

Add an explicit trigger clause, e.g. "Use when the user mentions distributed training, multi-GPU/multi-node runs, or wants to convert a PyTorch script to run on multiple GPUs."

Include natural synonyms users would say: "distributed training", "multi-GPU", "DDP", "DeepSpeed", "FSDP", "mixed precision" — currently only 'PyTorch training' and 'GPUs' appear.

Name the library (HuggingFace Accelerate) in the description to distinguish it from raw torchrun, DDP, or Lightning skills that would otherwise match the same triggers.

DimensionReasoningScore

Specificity

"Run PyTorch training across GPUs with minimal changes" names the domain (PyTorch, GPUs) and one concrete action (run training), but 'minimal changes' is a property, not a capability, and coverage of what the skill actually does (configure, launch, distributed setups) is absent. It matches anchor 3 (domain plus 1-2 concrete actions, not comprehensive) — not 4, which requires several specific actions.

3 / 5

Completeness

The 'what' is clear (run PyTorch training across GPUs) but there is no 'when' clause at all — no "Use when..." or equivalent trigger guidance, which the guidelines cap at 3. Not score 2 because the 'what' is concrete rather than vague; not 4 because the 'when' is entirely missing, not just weakly implied.

3 / 5

Trigger Term Quality

Natural terms like "PyTorch training" and "GPUs" are present, but common user phrasings are missing: "distributed training", "multi-GPU", "DDP", "DeepSpeed", "FSDP", "mixed precision" — the exact vocabulary the skill body itself targets. Some relevant keywords with missing variations/synonyms matches anchor 3, not 4 ("good keyword coverage, a few natural terms missing" would need most of these).

3 / 5

Distinctiveness Conflict Risk

"Run PyTorch training across GPUs" occupies a fairly distinct niche (distributed PyTorch training tooling) with minimal conflict risk against unrelated skills. It is not a 5 because it could still collide with closely related skills like raw torchrun/DDP or PyTorch Lightning setup skills, since it lacks distinguishing terms like 'Accelerate', 'DeepSpeed', or 'FSDP'.

4 / 5

Total

13

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

13

/

16

Passed

Repository
NousResearch/hermes-agent
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.