CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

peft

Fine-tune large LLMs with LoRA on limited GPU memory.

53

Quality

67%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./optional-skills/mlops/peft/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

68%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is a strong, code-first reference: executable examples dominate, parameter selection is tabulated with recommendations, and advanced/troubleshooting material is appropriately split into real one-level-deep reference files. The main gaps are the absence of an explicit ordered workflow with validation checkpoints and minor executability slips in a few examples.

Suggestions

Add a short numbered end-to-end workflow (configure → train → save → evaluate on held-out data → merge → deploy) with an explicit validation checkpoint before merging.

Fix minor code gaps: import torch in the quick-start collator, and define `inputs`/`model`/`dataset` in the multi-adapter and TRL examples so every block runs as-is.

Move the 'Common issues' section's detail into references/troubleshooting.md (keeping a one-line pointer) to reduce duplication and tighten the token budget.

DimensionReasoningScore

Conciseness

The body is code-dense with minimal prose padding — almost every section is executable examples or comparison tables with brief inline comments ('r=16, # Rank (8-64, higher = more capacity)'), assuming Claude's competence. It is not a 5 because the 'Common issues' section duplicates content that belongs in the provided troubleshooting.md reference, and the benchmark tables partly restate knowledge Claude has. Not a 3 because the over-explanation is limited to isolated instances rather than pervasive.

4 / 5

Actionability

Nearly all guidance is executable, copy-paste-ready code: full LoRA and QLoRA configs, save/merge/multi-adapter serving, per-architecture target_modules lists, and concrete fixes for OOM. It is not a 5 because of minor gaps: the quick-start collator uses `torch` without importing it, the multi-adapter and TRL examples reference undefined variables (`inputs`, `model`, `dataset`). Not a 3 because these are small omissions in otherwise complete, runnable examples.

4 / 5

Workflow Clarity

The end-to-end process (configure → train → save adapter → evaluate → merge → deploy) is present but spread across parallel recipe sections with implicit sequencing and no explicit validation checkpoints beyond 'Evaluate on held-out data before merging' in best practices, matching the 'sequence present but checkpoints missing or implicit' anchor. It is not a 4 because no step-by-step ordered workflow with checkpoints ties the recipes together, and not a 2 because each section's steps are well-defined and error recovery is addressed in Common issues.

3 / 5

Progressive Disclosure

The body is a well-sectioned overview that clearly signals two real, one-level-deep references ('[Advanced Usage](references/advanced-usage.md) — DoRA, LoftQ...', '[Troubleshooting](references/troubleshooting.md) — Common errors...'), both of which exist in the bundle and contain no nested references. It is not a 5 because some advanced material (method comparison tables, benchmarks, integration patterns) could live in advanced-usage.md, and the Common issues section overlaps the troubleshooting reference. Not a 3 because structure and navigation are good and references are clearly signaled.

4 / 5

Total

15

/

20

Passed

Description

53%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concise and names a concrete capability, but it omits the breadth of the skill (QLoRA, adapters, merging) and, most importantly, lacks any 'use when' trigger guidance, capping completeness at 3. Keyword coverage is adequate but misses the PEFT/QLoRA synonyms the skill body itself emphasizes.

Suggestions

Add an explicit trigger clause, e.g. 'Use when fine-tuning LLMs with LoRA/QLoRA, when GPU memory is limited, or when the user mentions PEFT, adapters, or parameter-efficient fine-tuning.'

Include natural synonyms users actually say — 'PEFT', 'QLoRA', 'adapters', 'parameter-efficient' — to broaden trigger term coverage.

Mention 1-2 more concrete actions (e.g. 'train adapters and merge them into base models') to lift specificity toward comprehensive coverage.

DimensionReasoningScore

Specificity

The description names the domain (LLM fine-tuning) and one concrete action with a constraint ('Fine-tune large LLMs with LoRA on limited GPU memory'), but does not list additional actions (QLoRA, adapters, merging) that the skill actually covers, matching the '1-2 concrete actions, not comprehensive' anchor. It is not a 4 because it lacks several specific actions, and not a 2 because 'Fine-tune... with LoRA' is a concrete action, not merely a named domain.

3 / 5

Completeness

The 'what' is clear (fine-tune large LLMs with LoRA on limited GPU memory), but there is no 'Use when...' clause or equivalent explicit trigger guidance, which caps completeness at 3 per the judging guidelines. It is not a 2 because the 'what' is concrete rather than vague, and not a 4 because 'when' is entirely absent rather than merely implicit.

3 / 5

Trigger Term Quality

'Fine-tune', 'LoRA', 'LLMs', and 'GPU memory' are relevant natural keywords a user might say, but common variations like 'PEFT', 'QLoRA', 'parameter-efficient', 'adapter', or 'quantization' are missing, matching the 'some relevant keywords but missing common variations' anchor. It is not a 4 because the synonym coverage is thin for a skill whose body covers QLoRA and 25+ methods.

3 / 5

Distinctiveness Conflict Risk

'LoRA' and 'limited GPU memory' carve out a reasonably distinct niche that would not trigger for unrelated skills, with only minor overlap risk against closely related quantization or general fine-tuning skills. It is not a 5 because the phrasing is terse enough that a broader 'fine-tuning' request might not clearly route here, and not a 3 because LoRA/PEFT is a well-defined, specific domain.

4 / 5

Total

13

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

13

/

16

Passed

Repository

NousResearch/hermes-agent

Path

optional-skills/mlops/peft/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.