CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

pytorch-lightning

High-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from laptop to supercomputer with same code. Use when you want clean training loops with built-in best practices.

58

Quality

73%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./backend/cli/skills/ml-training/pytorch-lightning/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

67%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured, code-first overview with real one-level-deep references and good troubleshooting feedback loops. Its weaknesses are redundancy (Workflow 2 repeating the quick start, callbacks duplicated inline) and promotional filler in the advantages/resources sections that inflates token cost without adding instruction value.

Suggestions

Trim Workflow 2's repeated training_step and configure_optimizers to a comment like '# ... (training_step as in quick start)' and cut the 'Key advantages'/'Resources' marketing bullets ('battle-tested', '1M+ downloads/month', Discord link, Kaggle winners).

Deduplicate callbacks coverage: keep Workflow 4 as a two-line pointer or a minimal single callback and defer ModelCheckpoint/EarlyStopping detail to references/callbacks.md.

Add brief validation checkpoints for the riskier workflows, e.g., confirming the checkpoint file exists after training or sanity-checking a 1-batch run before launching a multi-node job.

DimensionReasoningScore

Conciseness

The body is code-dominant and mostly efficient, but Workflow 2 re-declares training_step and configure_optimizers nearly verbatim from the quick start, and the 'Key advantages' and 'Resources' sections carry promotional filler ('battle-tested', 'Used by: Kaggle winners', Discord link) that earns no instruction value. Not a 2 because there is no conceptual over-explanation of things Claude already knows.

3 / 5

Actionability

All five workflows and every troubleshooting issue come with concrete, executable code (installation, 3-step conversion, DDP trainer config, callback wiring, LR scheduler dict format). Not a 5 because of small gaps such as train_dataset being used before definition in the quick start and `model` being undefined in the Workflow 2 snippet.

4 / 5

Workflow Clarity

The 3-step conversion path ('Step 1: Define LightningModule... Step 2: Create data... Step 3: Train with Trainer') is clearly sequenced, and the 'Common issues' section provides explicit error-recovery guidance including a WRONG/CORRECT contrast for the fit call and a CPU-first debugging sequence. Not a 5 because there are no explicit validation checkpoints (e.g., verifying a checkpoint file or sanity-checking before a long multi-node run).

4 / 5

Progressive Disclosure

The 'Advanced topics' section points to three real, one-level-deep reference files (references/callbacks.md, distributed.md, hyperparameter-tuning.md), each well-signaled with a summary of its contents and verified to contain no further nested references. Not a 5 because Workflow 4 inlines checkpoint/early-stopping detail that substantially duplicates references/callbacks.md, a minor organization gap.

4 / 5

Total

15

/

20

Passed

Description

70%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that names concrete capabilities and includes an explicit 'Use when' clause. Its main deductions are the second-person 'you want' phrasing (voice penalty) and trigger coverage that omits common synonyms like 'Lightning' or 'fine-tuning'.

Suggestions

Rewrite in third person to avoid the voice penalty, e.g., 'Use when the user wants clean training loops with built-in best practices' or 'Use for PyTorch training with multi-GPU scaling, callbacks, or mixed precision'.

Broaden trigger terms with natural synonyms users actually say: 'PyTorch Lightning', 'Lightning', 'fine-tune a model', 'train on multiple GPUs', 'mixed precision'.

Expand the 'when' clause to cover the other common entry points shown in the body, such as converting an existing PyTorch loop or setting up DDP/FSDP/DeepSpeed.

DimensionReasoningScore

Specificity

The description names the domain and several concrete features ('Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system'), which on its own merits a 4; however, the second-person phrasing 'Use when you want clean training loops' triggers the rubric's voice penalty of -1 for this dimension. Not a 2 because the feature list is specific, not minimal or generic.

3 / 5

Completeness

Both parts are explicit: the 'what' ('High-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system') and the 'when' ('Use when you want clean training loops with built-in best practices'). Not a 5 because the 'when' clause covers a single trigger case and could be more concrete (e.g., multi-GPU scaling or callback needs).

4 / 5

Trigger Term Quality

'PyTorch', 'distributed training', 'DDP', 'FSDP', 'DeepSpeed', and 'training loops' are natural terms users would say when needing this skill. Not a 5 because common synonyms like 'Lightning', 'fine-tuning', or 'train a model' are missing.

4 / 5

Distinctiveness Conflict Risk

Terms like 'Trainer class', 'DDP/FSDP/DeepSpeed', and 'callbacks system' carve a distinct niche with minimal overlap against raw-PyTorch or general ML skills. Not a 5 because 'High-level PyTorch framework' could still contend with a plain PyTorch-training skill.

4 / 5

Total

15

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

14

/

16

Passed

Repository

synthetic-sciences/openscience

Path

backend/cli/skills/ml-training/pytorch-lightning/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.