CtrlK
BlogDocsLog inGet started
Tessl Logo

pytorch-lightning

Clean training loops with built-in distributed support.

52

Quality

60%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./optional-skills/mlops/pytorch-lightning/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable with copy-paste-ready examples across the main Lightning workflows and a sensible troubleshooting section, but it is longer than necessary due to repeated module definitions, marketing fluff, and inlined content that overlaps with the provided reference files. Progressive disclosure is well implemented through real, clearly signaled one-level-deep references.

Suggestions

Deduplicate the repeated LitModel definitions across Workflows 1–5 by defining it once and referencing it, and trim promotional lines ('battle-tested', '1M+ downloads/month', 'That's it!') that do not aid execution.

Move the inlined distributed/callbacks detail that duplicates the reference files into pointers, keeping the overview lean.

Add explicit validation checkpoints in workflows (e.g. 'confirm val_loss decreases each epoch before scaling to multi-GPU') and relocate the version number to a clearly marked section so time-sensitive info does not bloat the overview.

DimensionReasoningScore

Conciseness

The body is mostly efficient with concrete code, but includes unnecessary repetition (LitModel is redefined across multiple workflows), marketing padding ('battle-tested', '1M+ downloads/month', '40+ lines → 15 lines', 'That's it!'), and a time-sensitive 'Version: 2.5.5+' line outside any deprecated section, matching the score-3 anchor 'Mostly efficient but includes some unnecessary explanation or could be tightened.' It is not score 4 because the repetition and promotional fluff are more than minor.

3 / 5

Actionability

The body provides fully executable, copy-paste-ready code covering the common cases — training, validation/testing, DDP, callbacks, LR scheduling, and troubleshooting — each with complete imports and runnable snippets, matching the score-5 anchor. It is not score 4 because examples are complete rather than having minor gaps.

5 / 5

Workflow Clarity

The Quick start is a clearly numbered 3-step sequence and each workflow is a coherent, ordered procedure with a 'Result' summary; the 'Common issues' section acts as troubleshooting feedback. It is not score 5 because explicit validation checkpoints (e.g. verify loss decreases, verify checkpoint saved) are implicit rather than stated as validate-fix-retry loops, matching the score-4 anchor 'Clear sequence with most checkpoints present; minor validation gaps.'

4 / 5

Progressive Disclosure

Structure is good: an overview body with clearly signaled, one-level-deep references to real bundle files (references/callbacks.md, distributed.md, hyperparameter-tuning.md), each described by topic. It is not score 5 because the main body (~335 lines, five full workflows, hardware and resources sections) is heavier than a lean overview and inlines content that partly belongs in those reference files, matching the score-4 anchor 'Good structure; most content appropriately placed; minor organization gaps.'

4 / 5

Total

16

/

20

Passed

Description

45%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concise and names its domain, but it describes an outcome rather than concrete capabilities and lacks any 'Use when...' trigger guidance, capping completeness at 3. Trigger-term and distinctiveness coverage are adequate but not comprehensive.

Suggestions

Reword as concrete actions, e.g. 'Organizes PyTorch code into structured LightningModules and automates distributed training (DDP, FSDP, DeepSpeed), logging, and checkpointing.'

Add an explicit trigger clause such as 'Use when writing or refactoring PyTorch training loops, or when the user needs multi-GPU/distributed training.'

Include the natural term 'PyTorch Lightning' and common synonyms (DDP, FSDP, training framework) so the skill triggers on the phrases users actually say.

DimensionReasoningScore

Specificity

The phrase 'Clean training loops with built-in distributed support' names the domain but offers no concrete actions (no verbs describing what the skill does); it is a property/outcome statement rather than a capability list, matching the score-2 anchor 'Names the domain but actions are minimal or generic.' It is not score 3 because there is no clearly stated action, and not score 1 because the domain is concretely named.

2 / 5

Completeness

There is a clear-ish 'what' (clean training loops, distributed support) but no 'when' / 'Use when...' trigger clause, which per the judging guidelines caps completeness at 3. It is not score 2 because the 'what' is identifiable, and not score 4 because no explicit trigger guidance is present.

3 / 5

Trigger Term Quality

'training loops' and 'distributed' are relevant natural terms a user might say, but the description omits common variations and synonyms (e.g. 'PyTorch Lightning', 'DDP', 'FSDP', 'training framework'), matching the score-3 anchor of some relevant keywords missing common variations. It is not score 4 because keyword coverage is thin rather than merely missing a few terms.

3 / 5

Distinctiveness Conflict Risk

'training loops' plus 'distributed support' is somewhat specific to training frameworks but overlaps with closely related tools (Accelerate, Ray Train, raw PyTorch), matching the score-3 anchor 'Somewhat specific but could still overlap with similar skills.' It is not score 4 because the framing is generic enough to also describe those alternatives.

3 / 5

Total

11

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

13

/

16

Passed

Repository
NousResearch/hermes-agent
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.