CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

deepspeed

Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention

42

Quality

53%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./cli-tool/components/skills/ai-research/distributed-training-deepspeed/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

25%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is essentially a documentation dump: full scraped tutorials inlined into SKILL.md with broken formatting, duplicated content, and navigation debris, while a large, well-separated references/ bundle goes underused with vacuous index entries. Genuine executable content (config JSON, API snippets) exists but is buried and unsequenced.

Suggestions

Move the scraped tutorial dumps (the "Patterns") out of SKILL.md into the existing references/ files, keeping SKILL.md a lean overview of triggers, a quick-start snippet, and well-described pointers.

Give each reference file a real one-line description of what it contains, list index.md, and fix or remove pointers to nonexistent targets ("getting_started", "api, guides", the empty scripts/ and assets/ placeholder sections).

Reformat the embedded code and JSON examples into properly fenced, copy-paste-ready blocks, remove the verbatim MoS duplication and TOC/"Previous Next" debris, and add a simple ordered workflow (e.g., write ds_config.json → launch with deepspeed launcher → verify with ds_report) with a validation step.

DimensionReasoningScore

Conciseness

The body inlines entire scraped tutorial pages (e.g., Pattern 1's full DeepNVMe tutorial) with table-of-contents debris and "Updated: November 5, 2025 Previous Next" navigation remnants, the MoS paragraph is repeated verbatim in Patterns 2 and 3, and stray fenced code blocks contain single meaningless tokens ("libaio", "80", "32"). This is severely padded, matching the anchor for heavily padded, severely verbose content.

1 / 5

Actionability

Real concrete material is present — the fenced aio_handle snippet, complete ds_config JSON blocks (fp16, zero_optimization, optimizer), and the ds_nvme_tune command with output — but most code is flattened into prose without code fences ("### Create aio_handle from deepspeed.ops.op_builder import AsyncIOBuilder...") and there is no guidance on which steps to actually take. Not a 4 because the formatting and sequencing gaps are far more than minor; not a 2 because the concrete config/API material is genuinely executable in substance.

3 / 5

Workflow Clarity

There is no task workflow — no numbered sequence, no validation checkpoints, and no debugging loop anywhere in the body; the only rough sequence is the routing in "Working with This Skill" ("Start with the getting_started or tutorials reference files"), which points to a file that does not exist. Not a 1 because that routing plus the reference-file list provides a rough, if gappy, navigation order.

2 / 5

Progressive Disclosure

Tens of thousands of tokens of documentation that clearly belongs in the reference files (a 550KB references/tutorials.md already exists) are inlined into SKILL.md, while the reference list is present but vacuous ("08.md - 08 documentation", "2020.md - 2020 documentation"), omits index.md, and navigation points to nonexistent files ("getting_started", "api, guides") and empty placeholder directories (scripts/, assets/). This matches the anchor for content that clearly belongs in separate files being inlined.

2 / 5

Total

8

/

20

Passed

Description

61%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description identifies a specific, niche tool and enumerates its key subsystems, giving good trigger-term coverage and low conflict risk. Its main weaknesses are the absence of any "Use when..." trigger clause (capping completeness at 3) and the replacement of concrete actions with the vague phrase "Expert guidance".

Suggestions

Append an explicit trigger clause, e.g., "Use when working with DeepSpeed configs, ZeRO stages, pipeline parallelism setup, mixed-precision training, or debugging distributed training jobs."

Replace the vague "Expert guidance" framing with concrete actions, e.g., "Configure ZeRO stages and offloading, write ds_config JSON, enable FP16/BF16/FP8 mixed precision, debug DeepSpeed launch issues."

Add natural synonyms users actually type — "mixed precision", "offloading", "ZeRO-2/ZeRO-3", "ds_config" — to improve trigger term coverage toward a 5.

DimensionReasoningScore

Specificity

Names the domain plus five concrete topics ("ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention") but the only action is the generic "Expert guidance" — no concrete actions such as configure, debug, or optimize. Not a 4 because anchor 4 requires several specific actions, which a topic list without action verbs does not provide.

3 / 5

Completeness

The "what" is stated clearly via domain and topic enumeration, but there is no "Use when..." clause or equivalent trigger guidance anywhere in the description, which caps completeness at 3 per the rubric guideline. Not a 2 because the "what" is far from vague — it names a specific tool and its subsystems.

3 / 5

Trigger Term Quality

"DeepSpeed", "ZeRO", "pipeline parallelism", "FP16/BF16/FP8", and "sparse attention" are exactly the terms a user of this library would say. Not a 5 because natural synonyms and variations are missing — e.g., "mixed precision", "offloading", "ZeRO-2/ZeRO-3", "deepspeed config".

4 / 5

Distinctiveness Conflict Risk

DeepSpeed is a specific named tool and "ZeRO", "1-bit Adam" are distinctive triggers unlikely to fire the wrong skill. Not a 5 because broad terms like "FP16", "pipeline parallelism", and "distributed training" carry minor overlap risk with generic distributed-training or mixed-precision skills.

4 / 5

Total

14

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

davila7/claude-code-templates

Path

cli-tool/components/skills/ai-research/distributed-training-deepspeed/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.