CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

fine-tuning-expert

Use when fine-tuning LLMs, training custom models, or adapting foundation models for specific tasks. Invoke for configuring LoRA/QLoRA adapters, preparing JSONL training datasets, setting hyperparameters for fine-tuning runs, adapter training, transfer learning, finetuning with Hugging Face PEFT, OpenAI fine-tuning, instruction tuning, RLHF, DPO, or quantizing and deploying fine-tuned models. Trigger terms include: LoRA, QLoRA, PEFT, finetuning, fine-tuning, adapter tuning, LLM training, model training, custom model.

76

Quality

95%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is an exemplary implementation skill: a checkpointed five-step workflow, a fully executable LoRA working example with QLoRA and merge variants, and a well-signaled reference table backed by real bundle files. The one notable gap is that the dataset-validation checkpoint references a script (validate_dataset.py) that is not shipped in the bundle.

Suggestions

Ship the dataset validation script referenced by the workflow checkpoint (or point the checkpoint at the logic documented in references/dataset-preparation.md instead of an undefined validate_dataset.py), closing the actionability gap.

Clarify in Output Templates or the workflow that Claude is expected to generate validate_dataset.py itself if absent, so the checkpoint remains runnable in any environment.

DimensionReasoningScore

Conciseness

The body is lean: a one-line role statement, a compact workflow, a reference table, and dense commented code with no explanations of concepts Claude already knows. The slight overlap between workflow checkpoints and the MUST DO/MUST NOT lists is deliberate reinforcement rather than padding, so it fits anchor 5 (every token earns its place) better than anchor 4's 'over-explanation to trim'.

5 / 5

Actionability

The LoRA example is fully executable and copy-paste ready (complete LoraConfig, TrainingArguments, SFTTrainer, plus QLoRA variant and merge snippet), but the dataset checkpoint invokes 'python validate_dataset.py --input data.jsonl' — a script absent from the bundle (no scripts/ directory), leaving a minor gap that keeps it at anchor 4 rather than fully self-contained anchor 5.

4 / 5

Workflow Clarity

The five-step Core Workflow is clearly sequenced with explicit validation checkpoints and a feedback loop: 'fix all errors before proceeding', 'validation loss must decrease; plateau or increase signals overfitting', and metrics/latency gates before deployment — matching anchor 5's explicit validation with error-recovery loops.

5 / 5

Progressive Disclosure

A Reference Guide table with a 'Load When' column links to five references/*.md files that all exist, contain substantive one-level-deep content, and nest no further references — a clear overview with well-signaled references and easy navigation, matching anchor 5.

5 / 5

Total

19

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it explicitly states both what the skill does and when to use it, enumerates many concrete capabilities, and provides a rich set of natural trigger terms with synonym variants. Its only weakness is a few overly broad terms ('model training', 'custom model', 'quantization') that slightly raise wrong-skill overlap risk.

DimensionReasoningScore

Specificity

The description lists ~10 concrete actions ('configuring LoRA/QLoRA adapters, preparing JSONL training datasets, setting hyperparameters for fine-tuning runs... RLHF, DPO, or quantizing and deploying fine-tuned models') with comprehensive coverage of the fine-tuning domain, matching the anchor-5 example of multiple specific concrete actions.

5 / 5

Completeness

Both 'what' (the enumerated concrete actions) and 'when' are explicitly answered via 'Use when fine-tuning LLMs, training custom models, or adapting foundation models' plus 'Invoke for...', mirroring the anchor-5 pattern of an explicit Use-when clause with concrete trigger phrases.

5 / 5

Trigger Term Quality

Trigger terms ('LoRA, QLoRA, PEFT, finetuning, fine-tuning, adapter tuning, LLM training, model training, custom model', plus RLHF, DPO, transfer learning, quantization) are natural phrases users would say, with hyphenation/spelling variants covered — comprehensive synonym coverage per the anchor-5 example.

5 / 5

Distinctiveness Conflict Risk

The dominant trigger set (LoRA, QLoRA, PEFT, RLHF, DPO, instruction tuning) carves a clear fine-tuning niche, but broad terms like 'model training', 'custom model', 'model optimization', and 'quantization' create minor overlap risk with general ML or DevOps skills — mostly distinct with minor overlap, matching anchor 4 rather than the minimal-conflict anchor 5.

4 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

Jeffallan/claude-skills

Path

skills/fine-tuning-expert/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.