CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

vision-sft

Fine-tune vision-language models (VLMs) with supervised learning on image+text data. Use when adapting a VLM to a visual domain or task, configuring frozen-vision-tower LoRA, or debugging a VLM fine-tune that trains without learning.

68

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality expert-level skill body: decision-first structure, concrete hyperparameters and code, explicit validation checkpoints with a recovery loop, and exemplary progressive disclosure through one real, well-described reference file. The only weaknesses are mild redundancy around the 'trains without learning' theme and the absence of an inline end-to-end example, which is at least an explicitly declared handoff rather than an omission.

Suggestions

Trim the redundancy between 'The Two Silent Killers' and 'Failure Modes' — the Failure Modes section could compress to two sentences pointing back at the checklist instead of restating the silent-killer framing.

Inline the three pre-training validation checks as a numbered mini-checklist in SKILL.md (or a short excerpt), so the critical validation sequence does not require loading the reference file to execute.

Consolidate the QLoRA/frozen-vision-tower pairing rule into one stated location and cross-reference it, rather than restating it in both the Consensus Recipe and the Quick Reference rows.

DimensionReasoningScore

Conciseness

The body is dense and expert-level with no padding explaining concepts Claude already knows — it jumps straight to defaults ("Frozen tower+projector, LoRA r=8–16, α=16–32") and empirical numbers ("+1.7pt DocVQA at ~1.75x training cost"). Minor redundancy keeps it below anchor 5: the trains-without-learning point is restated across the Two Silent Killers and Failure Modes sections, and the QLoRA/vision-tower pairing rule is stated twice.

4 / 5

Actionability

Mostly executable guidance: a concrete parameter-freezing loop, an explicit target-modules list, and specific hyperparameter ranges (r=8–16, α=16–32, vision LR 5–10x lower, last-6 ViT layers). It stops short of a complete runnable training script, but that is an explicitly declared handoff ("a validated adapter config ... that llm-finetuning-training-engineer consumes"), so it fits anchor 4 with minor gaps rather than anchor 5's copy-paste-ready coverage.

4 / 5

Workflow Clarity

A clear decision workflow: a Quick Reference decision table, an explicit escalation path for unfreezing, and pre-training validation ("Validate the 1:1 placeholder-to-media mapping before training starts, on every example, not just a sample") plus a recovery loop ("flat eval score next to a normal loss curve means re-run the checklist ... before touching any hyperparameter"). It sits just below anchor 5 because the full validation checklist itself lives in the reference file rather than being sequenced inline.

4 / 5

Progressive Disclosure

The body is a well-organized overview with a single one-level-deep reference, clearly signaled multiple times and summarized in a dedicated References section describing exactly what the file contains. The referenced file (references/collators-and-pitfalls.md) exists and delivers the promised content (collator table, dataset format, validation checklist, two-stage projector recipe). This matches the anchor for clear overview with well-signaled, one-level-deep references.

5 / 5

Total

17

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete actions, an explicit 'Use when' clause with natural trigger phrases, and a clearly distinct niche (VLM SFT with frozen-vision-tower LoRA). Keyword coverage could be marginally broader with synonyms like 'multimodal', but every dimension lands at or above the good-anchor level.

DimensionReasoningScore

Specificity

The description names the domain and several concrete actions — "Fine-tune vision-language models (VLMs) with supervised learning on image+text data", "configuring frozen-vision-tower LoRA", "debugging a VLM fine-tune that trains without learning" — matching the anchor for several specific actions with minor gaps. It falls short of anchor 5 only because the capability list is not fully comprehensive (e.g., the resolution-budget tuning from the body is absent).

4 / 5

Completeness

It clearly answers both questions: a concrete "what" ("Fine-tune vision-language models (VLMs) with supervised learning on image+text data") followed by an explicit "Use when" clause with three concrete trigger conditions. This matches the anchor for explicitly answering both what and when with concrete trigger phrases.

5 / 5

Trigger Term Quality

Good natural keyword coverage: "fine-tune", "VLM", "vision-language models", "image+text", "adapting", "debugging" — phrases a user would plausibly say. A few natural terms are missing (e.g., "multimodal", common architecture names like LLaVA/Qwen-VL), keeping it at anchor 4 rather than 5.

4 / 5

Distinctiveness Conflict Risk

It carves out a clear niche — supervised fine-tuning of vision-language models specifically — and the "frozen-vision-tower LoRA" trigger distinguishes it from text-only LoRA/QLoRA skills. Minimal conflict risk with neighboring skills.

5 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

15

/

16

Passed

Repository

wshobson/agents

Path

plugins/llm-finetuning/skills/vision-sft/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.