CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

hugging-face-model-trainer

Train language models using TRL (Transformer Reinforcement Learning) on fully managed Hugging Face infrastructure. No local GPU setup required—models train on cloud GPUs and results are automatically saved to the Hugging Face Hub.

Quality

64%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./plugins/AI-Agents-Safe-Coding-Skills-claude/skills/hugging-face-model-trainer/SKILL.md

The canonical home for this skill is hugging-face-model-trainer in administrakt0r/AI-Agents-Safe-Coding-Skills

SKILL.md
Quality
Evals
Security

Quality

Content

62%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is highly actionable with an excellent validate-then-train workflow (explicit checkpoints, mapping code, checklists, failure-mode recovery), but it is noticeably verbose — timeout and token directives repeated 4+ times, a Key Takeaways section that restates everything, and background explanations Claude doesn't need — and its progressive disclosure is undermined because every referenced bundle file (references/ and scripts/) is missing from the provided skill.

Suggestions

Consolidate the repeated timeout and HF_TOKEN/secrets warnings into one authoritative section and delete the Key Takeaways recap, which restates the Key Directives and Critical Settings almost verbatim — this alone would cut hundreds of lines.

Ship the referenced bundle files (references/*.md and scripts/*.py) or inline the small amount of content that is solely deferred to them (notably the complete GGUF conversion script, currently an unexecutable placeholder).

Remove the 'What is GGUF' explanatory bullets and other background Claude already knows, fix the 'Load these scripts for correctly' typo, and delete the orphaned paragraph after the Trackio defaults section.

DimensionReasoningScore

Conciseness

The body is noticeably verbose with several padded/duplicated sections: the timeout warning ("Default 30min TOO SHORT") and the HF_TOKEN/secrets directive each appear 4+ times (Key Directives, Prerequisites, Critical Settings, Timeout Management, Key Takeaways); the entire "Key Takeaways" section restates earlier directives; and it explains concepts Claude already knows ("What is GGUF: Optimized for CPU/GPU inference with llama.cpp..."). There is also an orphaned paragraph ("This is useful for managing multiple jobs with the same configuration...") and a typo ("Load these scripts for correctly"), indicating under-edited padding. Not 3: the redundancy is extensive (a ~720-line body where a tightened version could be roughly half the size), not just occasional over-explanation.

2 / 5

Actionability

Most guidance is concrete and executable: a complete copy-paste `hf_jobs("uv", {...})` SFT example with PEP 723 header, correct-vs-wrong CLI syntax blocks, dataset validation workflow with copy-paste mapping code, and a runnable cost-estimation command. Not 5: the "Quick conversion" GGUF snippet passes a literal placeholder string ("<see references/gguf_conversion.md for complete script>") instead of code, and MCP tool names are inconsistent (`hf_whoami()` vs `mcp__huggingface__hf_whoami()`), leaving minor gaps in otherwise executable coverage. Not 3: nothing is pseudocode; nearly every example runs as written.

4 / 5

Workflow Clarity

The multi-step workflow is clearly sequenced with explicit validation checkpoints and feedback loops: a prerequisites checklist (auth, dataset, critical settings), a mandatory validate-before-train step (dataset inspector with ✓ READY / ✗ NEEDS MAPPING / ✗ INCOMPATIBLE outcomes plus copy-paste mapping code to apply and re-check), a numbered submit-then-report action sequence, a pre-submission verification checklist, and a failure-modes section with ordered fixes per error. This matches the anchor-5 pattern of explicit validation steps, error-recovery loops, and checklists.

5 / 5

Progressive Disclosure

In-body organization is decent and references are clearly signaled one level deep (a Resources section enumerating each `references/*.md` and `scripts/*.py` with one-line descriptions), but the actual bundle contains no `references/` or `scripts/` directories — all 14+ referenced paths (training_methods.md, train_sft_example.py, estimate_cost.py, etc.) do not exist in the provided skill, so navigation targets are missing and some critical content (the complete GGUF conversion script) is deferred solely to a nonexistent file. Not 2: the SKILL.md itself is not a monolith and reference signaling is explicit; not 4-5: well-signaled references to files that are absent from the bundle cannot be considered good progressive disclosure.

3 / 5

Total

14

/

20

Passed

Description

53%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description clearly states what the skill does with a concrete, distinct value proposition (managed cloud training, automatic Hub saving), but it completely lacks a "when to use" trigger clause and omits the natural vocabulary (fine-tune, SFT, DPO, GRPO) users would most likely say when needing this skill. It reads as half of a good description.

Suggestions

Append an explicit trigger clause, e.g.: "Use when the user wants to fine-tune or train a model (SFT, DPO, GRPO, reward modeling) on cloud GPUs without local infrastructure, or convert a trained model to GGUF for Ollama/LM Studio."

Include the natural trigger terms users actually say — "fine-tune", "fine-tuning", "SFT", "DPO", "GRPO", "LoRA" — in the description so the skill surfaces for those requests.

Mention the Hub persistence guarantee contextually distinct from generic Hugging Face skills (e.g., "for models that must be saved to the Hugging Face Hub after training") to reduce overlap with general Hub/upload skills.

DimensionReasoningScore

Specificity

The description names the domain and 1-2 concrete actions — "Train language models using TRL (Transformer Reinforcement Learning) on fully managed Hugging Face infrastructure" and "results are automatically saved to the Hugging Face Hub" — but omits the training methods the skill actually covers (SFT, DPO, GRPO) and GGUF conversion. Not score 4: it does not list several specific actions with only minor gaps; coverage of capabilities is thin relative to the body. Not score 2: the actions given are concrete (cloud GPU training, automatic Hub saving), not minimal or generic.

3 / 5

Completeness

The "what" is clear (train LMs with TRL on managed cloud GPUs with automatic Hub saving), but there is no "Use when..." clause or equivalent explicit trigger guidance, which caps completeness at 3 per the judging guidelines. Not 4: the "when" is not merely under-specified — it is entirely absent; not 2 because the "what" half is concrete and specific.

3 / 5

Trigger Term Quality

It includes some relevant natural keywords ("Train language models", "TRL", "Hugging Face", "GPU") but misses common variations users would actually say: "fine-tune"/"fine-tuning", "SFT", "DPO", "GRPO", "LoRA", "RLHF". Matches anchor 3 (relevant keywords but missing common variations/synonyms); not 4 because several high-frequency natural trigger phrases are absent, and not 2 because the terms present are domain-appropriate rather than generic.

3 / 5

Distinctiveness Conflict Risk

The description carves a clear niche — TRL training on fully managed Hugging Face Jobs infrastructure with auto-save to the Hub — with distinct triggers ("TRL", "Hugging Face", "cloud GPUs"). Not 5: it could still overlap with closely related skills such as a general Hugging Face Hub skill or an Unsloth fine-tuning skill, since it never says "fine-tune" or names methods that would disambiguate.

4 / 5

Total

13

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (721 lines); consider splitting into references/ and linking

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

referenced_paths_exist

Referenced path issues: 35 missing

Warning

Total

13

/

16

Passed

Repository

administrakt0r/AI-Agents-Safe-Coding-Skills

Path

plugins/AI-Agents-Safe-Coding-Skills-claude/skills/hugging-face-model-trainer/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.