CtrlK
BlogDocsLog inGet started
Tessl Logo

peft-fine-tuning

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.

68

Quality

82%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

65%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A highly actionable, code-rich PEFT reference with clear sequencing, but it is over-stuffed for an overview: benchmark tables, niche methods, and integration patterns sit inline rather than in the existing reference files, and the training workflow lacks explicit validation/feedback checkpoints for a batch operation.

Suggestions

Move benchmark tables (memory, training speed, MMLU) and the IA3/Prefix Tuning/P-Tuning examples plus the per-framework integration snippets into references/advanced-usage.md, leaving the body a lean quick-start + decision guidance overview.

Add an explicit validation checkpoint to the training workflow — e.g., after train(), evaluate on held-out data before merge_and_unload(), mirroring best practice #6 as an in-flow step rather than a bullet.

De-duplicate the in-body 'Common issues' section against references/troubleshooting.md, either summarizing one or two top fixes inline and pointing to the reference for the rest, or removing the overlap.

DimensionReasoningScore

Conciseness

The body is mostly efficient actionable reference material (code with terse comments, comparison tables) and avoids over-explaining concepts Claude already knows, but at ~420 lines it carries content that could be tightened or offloaded — full benchmark tables (memory, tokens/sec, MMLU) and niche method examples (IA3, Prefix Tuning). It is not level 3 because not every token earns its place in an overview skill, and not level 1 because it is not padded with redundant conceptual explanation.

2 / 3

Actionability

Provides fully executable, copy-paste-ready code for LoRA and QLoRA config, training, adapter loading/merging, multi-adapter serving, and TRL/Axolotl/vLLM integration, matching the 'fully executable code/commands; copy-paste ready' anchor. Not level 2 because the examples are complete and concrete rather than pseudocode or missing key details.

3 / 3

Workflow Clarity

The quick start lays out a clear sequence (install -> load -> config -> apply -> tokenize -> train -> save) with one implicit checkpoint (print_trainable_parameters), but for a batch training operation there is no explicit validate/retry feedback loop embedded in the workflow — verification ('evaluate on held-out data before merging') appears only in best practices and troubleshooting is reactive. Per the rubric, missing validation checkpoints for batch operations caps this at 2; it is not level 1 because a real sequence with some verification exists.

2 / 3

Progressive Disclosure

Two real, well-signaled one-level-deep references exist and are linked (references/advanced-usage.md, references/troubleshooting.md, both present on disk), but substantial advanced/niche content remains inline in the ~420-line body — benchmark tables, IA3/Prefix Tuning methods, and three integration-framework examples that belong in advanced-usage.md — and the in-body 'Common issues' section overlaps the dedicated troubleshooting reference. This matches 'content that should be separate is inline'; not level 3 because the split is incomplete, not level 1 because references are present, signaled, and only one level deep.

2 / 3

Total

9

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, third-person description that states concrete capabilities, provides an explicit 'Use when...' trigger clause, and uses natural user-facing keywords. It is distinctive and unlikely to conflict with other skills.

DimensionReasoningScore

Specificity

Lists multiple concrete capabilities — 'fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods', 'train <1% of parameters', 'multi-adapter serving' — matching the 'lists multiple specific concrete actions' anchor. It is not level 2 because it goes beyond naming a domain plus partial actions to enumerating distinct concrete capabilities, and uses third-person/impersonal voice so no specificity penalty applies.

3 / 3

Completeness

Explicitly answers what ('Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods') and when via an explicit 'Use when fine-tuning large models (7B-70B) with limited GPU memory...' clause, matching the level-3 anchor with explicit triggers. Not capped at 2 because an explicit 'Use when...' trigger clause is present.

3 / 3

Trigger Term Quality

Covers natural terms users would say when requesting this — 'fine-tuning', 'LoRA', 'QLoRA', 'limited GPU memory', '7B-70B', 'multi-adapter serving' — matching the 'good coverage of natural terms' anchor. Not level 2 because it includes common variations a user would actually utter rather than only technical jargon or a single keyword.

3 / 3

Distinctiveness Conflict Risk

Occupies a clear niche (PEFT/LoRA/QLoRA fine-tuning) with distinct triggers — parameter-efficient fine-tuning, GPU-memory-constrained training, multi-adapter serving — unlikely to fire for unrelated skills. Not level 2 because the triggers are specific to this domain rather than generically overlapping with adjacent skills.

3 / 3

Total

12

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository
Orchestra-Research/AI-Research-SKILLs
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.