CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

distributed-training-accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

Quality

72%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./cli-tool/components/skills/ai-research/distributed-training-accelerate/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

67%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a strong, example-driven guide: nearly every workflow is executable copy-paste code, the convert/configure/launch sequence is clear, and advanced topics are properly externalized to real one-level-deep reference files. Its weaknesses are redundant duplication between Quick start and Workflow 1, marketing-fluff sections that assume too little of the reader, and the absence of explicit validation checkpoints around heavy distributed launches.

Suggestions

Delete or collapse Workflow 1, which repeats the Quick start conversion example verbatim, and trim the 'Key advantages' bullet list — keep the 'When to use vs alternatives' comparison and let code speak for itself.

Add an explicit validation checkpoint before heavy launches, e.g., 'Verify with a single process first: accelerate launch --num_processes 1 train.py', plus guidance on reading launch errors and retrying.

Fix the DeepSpeed config example to be directly usable (integer bucket sizes, required accelerate_config fields) and move version pins ('1.11.0+', 'PyTorch 1.12+') into a clearly-labeled compatibility note.

DimensionReasoningScore

Conciseness

The body is mostly efficient code-focused content, but includes clear redundancy and padding: Workflow 1 ('single GPU to multi-GPU') repeats the exact 4-line conversion already shown in Quick start, and the 'Key advantages' bullet list ('4 lines: Minimal code changes', 'Unified API', 'Automatic') is marketing fluff that re-states the description rather than teaching anything new. Version pins ('Version: 1.11.0+', 'PyTorch 1.12+') are time-sensitive and sit in a general 'Resources' section rather than a deprecated/compatibility section, which the guidelines penalize. This matches the score-3 anchor of 'mostly efficient but includes some unnecessary explanation or could be tightened', and is not a 4 because the duplication and fluff sections are more than minor instances.

3 / 5

Actionability

Mostly executable guidance: Workflows 1-5 provide complete, copy-paste-ready Python scripts, plus concrete launch commands for single-GPU, multi-GPU, and multi-node setups and a DeepSpeed config file. It is not a 5 because the Quick start presents a +/- diff rather than runnable code, comments like '# Select: DeepSpeed → ZeRO-2' stand in for actual config steps, and the DeepSpeed JSON example has gaps (float value 5e8 for bucket sizes; the JSON omits the accelerate_config wrapper fields the earlier code example implies). It is not a 3 because there is far more concrete, executable material than pseudocode.

4 / 5

Workflow Clarity

The core convert → configure → launch sequence is clearly laid out per workflow with concrete commands at each step, and the 'Common issues' section supplies troubleshooting for typical failure modes (device placement, accumulation, checkpointing, FSDP seeds), matching the score-4 anchor of a clear sequence with most checkpoints present. It is not a 5 because there are no explicit validation checkpoints or feedback loops (e.g., verify a single-process run before launching 8 GPUs, or how to read launch errors and retry), and launching distributed jobs is a heavy batch-style operation where the guidelines favor verification.

4 / 5

Progressive Disclosure

Good structure with appropriately split content: Quick start and the five core workflows live inline, while three advanced topics (Megatron, custom plugins, performance) are one level deep in references/megatron-integration.md, references/custom-plugins.md, and references/performance.md — all verified to exist and clearly signaled with descriptive links. It is not a 5 because the ~320-line body carries substantial content (five full workflows plus an alternatives comparison) that a leaner overview could push to references, leaving minor organization gaps.

4 / 5

Total

15

/

20

Passed

Description

66%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description communicates a clear, concrete capability set for a well-defined niche, with strong framework-name keyword coverage. Its main weaknesses are the missing explicit 'Use when...' trigger clause (capping completeness) and marketing over-claims ('Simplest', 'HuggingFace ecosystem standard') that replace actionable trigger guidance, plus the surprising omission of the library name 'Accelerate'.

Suggestions

Add an explicit trigger clause, e.g., 'Use when the user wants to distribute or scale PyTorch training across multiple GPUs/nodes, or mentions accelerate, DeepSpeed, FSDP, DDP, or mixed precision.'

Replace the unverifiable claims 'Simplest distributed training API' and 'HuggingFace ecosystem standard' with concrete capabilities (e.g., gradient accumulation, distributed checkpointing) stated in third person.

Include the library name 'Accelerate' and common natural phrasings like 'multi-GPU' and 'multi-node' so the description matches what users actually say.

DimensionReasoningScore

Specificity

The description lists several concrete actions — '4 lines to add distributed support to any PyTorch script', 'Automatic device placement, mixed precision (FP16/BF16/FP8)', 'Interactive config, single launch command' — matching the score-4 anchor of several specific actions with minor coverage gaps (e.g., checkpointing and gradient accumulation are never mentioned). It is not a 5 because the opening 'Simplest distributed training API' and closing 'HuggingFace ecosystem standard' are unverifiable marketing claims rather than concrete capabilities, and it is not a 3 because the action list goes well beyond 1-2 generic actions.

4 / 5

Completeness

The 'what' is clear (unified API adding distributed support with device placement and mixed precision), but there is no 'Use when...' clause or equivalent explicit trigger guidance, which per the judging guidelines caps completeness at 3. It is not a 2 because the 'what' is concrete and multi-faceted, not vague.

3 / 5

Trigger Term Quality

Good keyword coverage with natural terms users would say: 'distributed training', 'PyTorch script', 'DeepSpeed', 'FSDP', 'Megatron', 'DDP', 'mixed precision'. It falls short of a 5 because common phrasings like 'multi-GPU', 'multi-node', 'scale training' are absent, and — notably — the library name 'Accelerate' itself never appears in the description, so a user asking to 'use accelerate' would not textually match.

4 / 5

Distinctiveness Conflict Risk

The niche is well-defined — distributed training of PyTorch scripts with named frameworks (DeepSpeed/FSDP/Megatron/DDP) — so wrong-skill triggering is unlikely, matching the score-4 anchor of 'mostly distinct; minor overlap risk'. It is not a 5 because the marketing framing ('Simplest', 'ecosystem standard') and absence of explicit trigger conditions leave slight overlap risk with generic PyTorch-performance or DeepSpeed-specific skills.

4 / 5

Total

15

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_field

'metadata' should map string keys to string values

Warning

Total

15

/

16

Passed

Repository

davila7/claude-code-templates

Path

cli-tool/components/skills/ai-research/distributed-training-accelerate/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.