CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

pytorch-lightning

High-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from laptop to supercomputer with same code. Use when you want clean training loops with built-in best practices.

60

Quality

75%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/distributed-training/pytorch-lightning/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

71%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, actionable reference with exemplary progressive disclosure — inline common cases, advanced detail in real one-level-deep files. Its main weakness is conciseness: triplicated boilerplate code and marketing/version fluff pad the body, and workflows lack explicit validation checkpoints.

Suggestions

Deduplicate the LitModel + training_step code repeated in Quick start, Workflow 1, and Workflow 2 — show the full pattern once and let later workflows show only the delta (as Workflow 5 already does with '# ... (training_step, etc.)').

Cut the marketing content that earns no tokens: the 'Key advantages' bullets ('1M+ downloads/month, battle-tested'), GitHub star counts, Discord link, and 'Used by: Kaggle winners' line.

Remove or contextualize the time-sensitive 'Version: 2.5.5+' pin, which will silently go stale, and add a quick sanity check (e.g. one-epoch smoke run on CPU before scaling to 8 GPUs) to the distributed workflow.

DimensionReasoningScore

Conciseness

Mostly efficient — the bulk is executable code and Lightning-specific facts Claude does not know — but the LitModel/training_step pattern is repeated three times (Quick start, Workflow 1, Workflow 2), and padded marketing sections ('Tested: 1M+ downloads/month, battle-tested', 'GitHub ... ⭐ 29,000+', 'Used by: Kaggle winners') plus a time-sensitive version pin ('Version: 2.5.5+') could be trimmed. Not 2 because the core content is genuinely useful rather than explanatory filler; not 4 because the duplication and fluff are noticeable.

3 / 5

Actionability

Mostly executable, copy-paste-ready guidance: a complete 3-step conversion example, concrete Trainer configurations for each workflow, and specific fixes in Common issues (e.g. 'precision='bf16'' for OOM, passing val_loader for missing validation). Minor gaps keep it below 5: train_dataset/model are used undefined in Workflow 2, and Workflow 5 elides training_step with '# ... (training_step, etc.)'.

4 / 5

Workflow Clarity

The conversion sequence is explicit and numbered ('Step 1: Define LightningModule', 'Step 2: Create data', 'Step 3: Train with Trainer'), and each workflow is self-contained; the Common issues section adds error-recovery guidance (e.g. test on CPU first, then GPU). Not 5 because there is no explicit validate-then-proceed checkpoint, and the workflows are parallel recipes rather than one sequenced process with feedback loops.

4 / 5

Progressive Disclosure

Clear overview structure: quick start and common workflows stay inline while advanced detail is correctly split into three real, one-level-deep bundle files (references/callbacks.md, references/distributed.md, references/hyperparameter-tuning.md), each clearly signaled in the Advanced topics section with its scope stated ('See [references/callbacks.md](references/callbacks.md) for EarlyStopping, ModelCheckpoint, custom callbacks, and callback hooks'). Verified all three files exist and contain no further nested references.

5 / 5

Total

16

/

20

Passed

Description

70%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with concrete capabilities and an explicit trigger clause, held back by second-person phrasing in the trigger, a 'when' that only covers one of the skill's use cases, and the absence of the word 'Lightning'. It clearly beats the vague-description anchors but sits just below the top exemplars.

Suggestions

Rewrite the trigger clause in third person and broaden its scope, e.g. 'Use when the user wants to train PyTorch models, needs distributed training (multi-GPU, multi-node, DDP/FSDP/DeepSpeed), or wants production-ready training loops.'

Include 'Lightning' in the description text itself so users naturally saying 'PyTorch Lightning' or 'Lightning Trainer' match without relying on the name field.

Mention the remaining concrete capabilities (validation/testing, checkpointing, mixed precision) in the 'what' to close the coverage gap for anchor-5 specificity.

DimensionReasoningScore

Specificity

Base match is anchor 4: the description lists several concrete capabilities ('Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate'). Reduced by 1 per the rubric guideline because the trigger clause 'Use when you want clean training loops with built-in best practices' uses second-person voice ('you want'), which the rubric explicitly penalizes.

3 / 5

Completeness

Both parts are present: the 'what' is clear and concrete ('High-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate') and the 'when' is explicit ('Use when you want clean training loops with built-in best practices'). Not 5 because the 'when' clause covers only the clean-loops use case and omits triggers for the skill's other capabilities (distributed training, multi-GPU scaling).

4 / 5

Trigger Term Quality

Good natural keyword coverage: 'PyTorch', 'distributed training', 'DDP', 'FSDP', 'DeepSpeed', 'training loops', 'callbacks' are terms users would actually say. Missing a few natural terms such as 'Lightning' itself, 'train my model', or 'neural network training', so not anchor 5.

4 / 5

Distinctiveness Conflict Risk

Mostly distinct: Lightning-specific concepts (Trainer class, callbacks system, DDP/FSDP/DeepSpeed strategies) form a clear niche. Minor overlap risk remains with generic PyTorch or Accelerate-style skills since 'High-level PyTorch framework' alone is broad and does not name Lightning.

4 / 5

Total

15

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

OpenLAIR/dr-claw

Path

skills/distributed-training/pytorch-lightning/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.