CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

peft-fine-tuning

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.

67

Quality

84%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-organized, highly actionable reference skill: executable code covering the main cases, decision tables for parameter selection, and real one-level-deep bundle references. The main improvement opportunities are moving the integration/benchmark material into the existing reference files and closing small gaps in the code snippets (undefined variables, missing torch import).

Suggestions

Move the Integration patterns (TRL/Axolotl/vLLM) and Performance benchmarks sections into a reference file (e.g. references/advanced-usage.md or a new references/integrations.md) to slim the main body and strengthen progressive disclosure.

Fix the minor code gaps: import torch in the standard LoRA example (the data_collator lambda uses it), and define or annotate the 'prompts', 'model', and 'dataset' variables used in the vLLM and TRL snippets.

Consider making the fine-tuning lifecycle explicit as a numbered workflow (choose method → configure → train → validate on held-out data → merge/save) so the sequence and its validation checkpoints are stated rather than implied by section order.

DimensionReasoningScore

Conciseness

The body is dense and reference-like — code-heavy sections, decision tables, minimal prose padding, and no re-explanation of concepts Claude already knows (it never explains what LoRA is theoretically). Minor trimmable spots remain: the benchmarks section (memory/speed/MMLU tables) and the PEFT methods comparison partially duplicate guidance, keeping it just below the 'every token earns its place' anchor.

4 / 5

Actionability

The standard LoRA example is a complete copy-paste pipeline (load, config, tokenize, train, save) and the architecture-specific target_modules lists are directly usable. Minor gaps keep it at 4 rather than 5: the data_collator lambda uses 'torch' without importing it, the vLLM example references an undefined 'prompts' variable, and the TRL snippet references undefined 'model'/'dataset' — matching 'mostly executable with minor gaps'.

4 / 5

Workflow Clarity

The section order mirrors the real lifecycle (choose method → install → configure → train → save/merge → serve) and includes checkpoints like 'model.print_trainable_parameters()', 'Evaluate on held-out data before merging', and the 'Adapter not applying' verification steps. The sequence is implicit in section layout rather than an explicit numbered workflow, and training is not a destructive/batch operation that would trigger the validation cap, so this fits 'clear sequence with most checkpoints present; minor gaps'.

4 / 5

Progressive Disclosure

The two bundle files (references/advanced-usage.md, references/troubleshooting.md) exist, are clearly signaled in a References section with one-line descriptions, and are one level deep. The ~420-line body is well-sectioned but inlines content that arguably belongs in those references (integration patterns with TRL/Axolotl/vLLM, benchmark tables, the IA3/Prefix-Tuning snippets), which is a minor organization gap rather than a significant one.

4 / 5

Total

16

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: explicit what-and-when structure, concrete quantified capabilities, and distinctive trigger terms. The only flaws are minor — a second-person clause ('when you need to train') that costs a specificity point and a few missing synonyms like 'PEFT' itself.

DimensionReasoningScore

Specificity

The description lists multiple concrete capabilities — 'fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods', 'multi-adapter serving', 'integrated with transformers ecosystem' — with quantified specifics (7B-70B, <1% of parameters). It would rate 5 for comprehensive concrete coverage, but the second-person phrasing 'when you need to train <1% of parameters' triggers the rubric's one-point voice penalty, capping it at 4.

4 / 5

Completeness

It clearly answers both questions: the 'what' is 'Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods' and the 'when' is an explicit 'Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving' — matching the top anchor with concrete trigger phrases.

5 / 5

Trigger Term Quality

Strong natural keywords users would actually say: 'fine-tuning', 'LoRA', 'QLoRA', 'limited GPU memory', 'adapters', '7B-70B'. A few natural terms are missing — the 'PEFT' acronym itself, and common variations like 'train' or 'adapter merging' — so it fits the 'good keyword coverage; a few natural terms missing' anchor rather than the comprehensive one.

4 / 5

Distinctiveness Conflict Risk

LoRA, QLoRA, parameter-efficient fine-tuning, and multi-adapter serving form a clear niche with distinctive trigger terms unlikely to fire for unrelated skills. The only mild overlap is with general 'fine-tuning' requests, but the memory-constraint and adapter triggers disambiguate; this sits at the 'clear niche, minimal conflict risk' anchor.

5 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

OpenLAIR/dr-claw

Path

skills/fine-tuning/peft/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.