CtrlK
BlogDocsLog inGet started
Tessl Logo

lora-qlora-recipes

Configure LoRA and QLoRA supervised fine-tuning with current best-practice hyperparameters. Use when writing or reviewing a LoRA/QLoRA training configuration, choosing rank/alpha/target modules, or deciding between LoRA, QLoRA, and full fine-tuning.

69

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-executed configuration recipe: executable code and specific values throughout, a clean decision structure with failure-mode diagnostics, and exemplary progressive disclosure that keeps detail in two real, clearly-signaled reference files. Only minor trimming of the routing preamble and inline version mentions keeps it from full marks on conciseness.

DimensionReasoningScore

Conciseness

The body assumes Claude's intelligence (no primers on what LoRA or fine-tuning are) and is dense with skill-specific conventions, but the routing preamble and DGX Spark OOM aside could be tightened, and inline time-sensitive version/date references ("Unsloth 2026.7.x", "Thinking Machines/Schulman, 2025-09") sit outside any old-patterns/deprecated section. Efficient with minor trimmable instances — the 4 anchor, not the every-token-earns-its-place 5.

4 / 5

Actionability

Fully executable guidance throughout: a concrete target_modules list, the complete FastLanguageModel.get_peft_model code block with the 2*r alpha derivation shown in-line, the 2e-4 QLoRA starting LR, rank-by-task tables, and a runnable `torch.cuda.is_bf16_supported()` check command. Copy-paste ready and covering the common cases — the 5 anchor; not 4 because there are no meaningful gaps.

5 / 5

Workflow Clarity

The decision flow is clearly sequenced (input contract → method-choice table → rank selection → concrete config → failure modes) with a diagnostic feedback loop ("Check configuration against this skill before debugging the training loop itself") and a hardware validation check for bf16. Not 5 because there is no explicit validation step for the emitted adapter config itself; not 3 because checkpoints are present and explicit, not merely implied.

4 / 5

Progressive Disclosure

Both referenced files (references/hyperparameters.md, references/unsloth-trl-mapping.md) exist, are one level deep, and are clearly signaled both inline at the point of need and in a dedicated References section with per-file descriptions. The body keeps only summaries and decisions inline while tables and full worked configs live in the references — matching the 5 anchor's clear overview with well-signaled one-level-deep references.

5 / 5

Total

18

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with an explicit 'Use when' clause and concrete, natural trigger terms covering the LoRA/QLoRA configuration domain. Its only weaknesses are minor: a slightly generic hyperparameter qualifier and small overlap risk with the sibling method-selection skill.

DimensionReasoningScore

Specificity

Lists several specific actions — "Configure LoRA and QLoRA supervised fine-tuning", "writing or reviewing a LoRA/QLoRA training configuration", "choosing rank/alpha/target modules" — but "current best-practice hyperparameters" is a mildly generic qualifier, leaving minor coverage gaps versus the comprehensive 5 anchor.

4 / 5

Completeness

Explicitly answers both: what ("Configure LoRA and QLoRA supervised fine-tuning with current best-practice hyperparameters") and when ("Use when writing or reviewing a LoRA/QLoRA training configuration, choosing rank/alpha/target modules, or deciding between LoRA, QLoRA, and full fine-tuning") with concrete trigger phrases. Matches the 5 anchor exactly; the 4 anchor's weaker/less-explicit 'when' does not apply.

5 / 5

Trigger Term Quality

Natural keywords users would say are well covered ("LoRA", "QLoRA", "fine-tuning", "training configuration", "rank/alpha", "target modules", "full fine-tuning"), but common synonyms like "SFT" spelled out as an abbreviation users say, "PEFT", or "adapter" are absent. Fits the 4 anchor (good coverage, a few natural terms missing), not 5 (no synonym/extension-level breadth) and clearly above 3.

4 / 5

Distinctiveness Conflict Risk

The adapter-configuration niche is clear and specific, but "deciding between LoRA, QLoRA, and full fine-tuning" invites minor overlap with a sibling method-selection skill in the same plugin family. Mostly distinct with minor overlap risk — the 4 anchor — rather than the minimal-conflict 5 anchor.

4 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
wshobson/agents
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.