CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

hugging-face-model-trainer

This skill should be used when users want to train or fine-tune language models using TRL (Transformer Reinforcement Learning) on Hugging Face Jobs infrastructure. Covers SFT, DPO, GRPO and reward modeling training methods, plus GGUF conversion for local deployment. Includes guidance on the TRL Jobs package, UV scripts with PEP 723 format, dataset preparation and validation, hardware selection, cost estimation, Trackio monitoring, Hub authentication, and model persistence. Should be invoked for tasks involving cloud GPU training, GGUF conversion, or when users mention training on Hugging Face Jobs without local GPU setup.

69

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A highly actionable, well-sequenced skill body with genuine validation loops around costly GPU operations and an effective reference bundle. Its main weaknesses are repetition of the same critical warnings across four sections (inflating token cost) and one unreferenced bundle file that breaks the otherwise clean navigation map.

Suggestions

Consolidate the repeated timeout/push-to-Hub/HF_TOKEN warnings into one authoritative section (e.g., Critical Settings) and reference it from Key Takeaways and Troubleshooting instead of restating them.

Reference references/reliability_principles.md in the Resources section or remove it from the bundle, so every bundle file is discoverable from SKILL.md.

Fix small editorial defects that cost clarity: the 'Load these scripts for correctly:' typo, the misplaced 'This is useful for managing multiple jobs...' paragraph in Trackio Configuration Defaults, and the double blank line after the Example Response block.

DimensionReasoningScore

Conciseness

Mostly efficient operational guidance rather than concept explanation, but the same critical warnings (30-minute default timeout, push-to-Hub/HF_TOKEN secrets) are restated nearly verbatim across Prerequisites, Timeout Management, Troubleshooting, and Key Takeaways, and the Trackio Configuration Defaults section ends with a misplaced paragraph ('This is useful for managing multiple jobs...'). This matches 'mostly efficient but includes some unnecessary explanation or could be tightened' — not level 2, since the padding is redundancy rather than teaching Claude things it already knows.

3 / 5

Actionability

Fully executable throughout: a complete inline SFT script with PEP 723 header and full hf_jobs() payload, correct-vs-wrong CLI syntax examples with explicit flag ordering rules, dataset mapping code, and a cost-estimation command with flags. This matches 'fully executable; copy-paste ready code or commands; specific examples cover the common cases'.

5 / 5

Workflow Clarity

The workflow is explicitly sequenced with validation checkpoints: a prerequisites checklist before any job, dataset validation on CPU with unambiguous result markers (✓ READY / ✗ NEEDS MAPPING / ✗ INCOMPATIBLE) before GPU spend, a pre-submission verification checklist, and ordered fix lists for each failure mode. For an expensive batch operation, the validate-before-execute loop is present, matching the anchor-5 pattern.

5 / 5

Progressive Disclosure

Good structure: the body is an overview with clearly signaled, one-level-deep references (references/*.md, scripts/*.py), all of which exist on disk, plus a consolidated Resources index. It falls short of 5 because references/reliability_principles.md exists in the bundle but is never referenced from SKILL.md, and the Resources section duplicates the inline 'See:' pointers rather than the body being a lean hub.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly covers both what the skill does and when to invoke it, in third person, with concrete capability enumeration and specific trigger conditions. The only gap is a handful of natural synonyms (LoRA, RLHF, Ollama/LM Studio) that would broaden trigger matching.

DimensionReasoningScore

Specificity

The description lists multiple concrete capabilities — 'train or fine-tune language models using TRL', 'SFT, DPO, GRPO and reward modeling', 'GGUF conversion', 'dataset preparation and validation, hardware selection, cost estimation, Trackio monitoring, Hub authentication, and model persistence' — with comprehensive coverage of the skill's surface. It matches the 'lists multiple specific concrete actions; comprehensive coverage' anchor and is not merely the minor-gaps level, since every major capability in the body is named.

5 / 5

Completeness

Both what and when are explicit: the what is the concrete capability list, and the when is 'Should be invoked for tasks involving cloud GPU training, GGUF conversion, or when users mention training on Hugging Face Jobs without local GPU setup', plus the opening 'when users want to train or fine-tune'. This mirrors the anchor-5 example structure with concrete trigger phrases.

5 / 5

Trigger Term Quality

Natural terms are well covered ('train', 'fine-tune', 'cloud GPU training', 'GGUF conversion', 'Hugging Face Jobs', 'TRL'), but a few phrases users would plausibly say are absent — e.g., LoRA, RLHF, instruction tuning, Ollama/LM Studio. This fits 'good keyword coverage; a few natural terms missing' rather than the comprehensive-with-synonyms anchor.

4 / 5

Distinctiveness Conflict Risk

It carves a clear niche — TRL training on Hugging Face Jobs managed infrastructure plus GGUF conversion — with distinct trigger terms ('Hugging Face Jobs', 'cloud GPU training', 'GGUF conversion') that are unlikely to fire for generic ML or document skills. Minor overlap with general fine-tuning tooling exists but the Jobs-specific framing keeps conflict risk minimal.

5 / 5

Total

19

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (732 lines); consider splitting into references/ and linking

Warning

metadata_version

'metadata.version' is missing

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

13

/

16

Passed

Repository

synthetic-sciences/openscience

Path

backend/cli/skills/ml-training/hugging-face-model-trainer/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.