CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

nemotron-customize

Configure and chain repo-native Nemotron steps for curation, tokenizer extension, SDG/BYOB, training, conversion, optimization, and evaluation.

Quality

76%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/nemotron-customize/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

73%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured, actionable router with excellent workflow sequencing, explicit validation checkpoints, approval gates, and error-recovery feedback loops. Its weaknesses are cross-section rule repetition that inflates length, per-step detail inlined despite the skill's own directive to keep such rules in references, and one orphaned bundle file.

Suggestions

Deduplicate rules repeated across sections: state the auth-env-var-names-only rule and the never-edit-checked-in-configs rule once each (e.g. in Safety and Customization Surface) and remove their near-identical restatements in Configuration Alignment, Operational Nuances, and Boundaries.

Move the per-step rules in Configuration Alignment and Operational Nuances that apply to single steps (e.g. LoRA merge base-checkpoint requirements, bin/idx data pairing) into the relevant bundled reference, keeping only cross-step guardrails in SKILL.md, consistent with the skill's own "Do not restate all per-step rules in SKILL.md" boundary.

Either add references/examples/CALIBRATION.md to the Reference Map or remove it from the bundle so every bundled file is discoverable from SKILL.md.

DimensionReasoningScore

Conciseness

The body is dense and repo-specific with no padding explaining concepts Claude already knows, but the same rules are restated across sections: "mention auth environment variable names only, never values" appears in Inputs, Configuration Alignment, and Operational Nuances; the never-edit-"default.yaml" rule appears in Customization Surface, Operational Nuances, and Boundaries; and route-from-bundled-references-first is repeated in Core Rule, Before You Begin, and Instructions. This repetition is more than minor trimming, matching "mostly efficient but could be tightened" rather than anchor 4's "minor instances".

3 / 5

Actionability

Guidance is largely executable: a numbered Single-Step Command Flow with verification ("uv run nemotron steps show <step_id>"), concrete config paths ("src/nemotron/steps/sft/megatron_bridge/config/my_super3.yaml"), specific field names (pack_size, seq_length), and a worked example command. It falls short of 5 because the example command is truncated with an ellipsis ("uv run nemotron steps run peft/automodel -c <config> --dry-run ...") and full command shapes are deferred to references/COMMANDS.md rather than included copy-paste ready.

4 / 5

Workflow Clarity

Multi-step processes are clearly sequenced with explicit validation checkpoints: the Single-Step flow verifies the live step before emitting commands, the Pipeline Workflow gates Act behind Plan approval ("Wait for approval before writing configs or code") and requires verifying "every generated YAML, artifact edge, command, and README command before reporting completion". Feedback loops for error recovery are present ("Two Act attempts fail -> Stop, explain what was tried" and the Troubleshooting table), and destructive/remote operations require confirmation, matching the anchor for clear sequence with explicit validation, feedback loops, and checklists.

5 / 5

Progressive Disclosure

The Reference Map table gives excellent question-to-file navigation and every referenced path resolves to a real bundle file, but there are minor organization gaps: the ~360-line body inlines substantial per-step rules (Configuration Alignment, Operational Nuances) that the skill itself says belong in bundled references, context packs require a two-hop route (SKILL.md -> references/context/index.toml -> matching pack), and references/examples/CALIBRATION.md exists in the bundle but is never referenced from SKILL.md. This matches anchor 4 (good structure, mostly appropriate placement, minor gaps) rather than 5.

4 / 5

Total

16

/

20

Passed

Description

70%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific, domain-anchored, and clearly distinct from other skills, with good natural keyword coverage across the seven supported domains. Its main weakness is the missing "Use when..." trigger clause, which caps completeness, alongside unexpanded jargon (SDG/BYOB) and the absence of the most common user phrasings like "fine-tune" or "SFT".

Suggestions

Add a "Use when..." clause or equivalent explicit trigger guidance, e.g. "Use when working in the Nemotron repo on model customization, fine-tuning (SFT/LoRA/RL), data curation, or model evaluation/benchmarking requests."

Spell out or add natural synonyms for abbreviated jargon: replace or augment "SDG/BYOB" with "synthetic data generation" and "bring-your-own-benchmark" so users who say those phrases trigger the skill.

Include the natural trigger terms users most often say for model customization — "fine-tune", "fine-tuning", "SFT", "LoRA", "PEFT", and "benchmark" — which the skill body explicitly handles but the description omits.

DimensionReasoningScore

Specificity

"Configure and chain repo-native Nemotron steps" names the domain plus concrete actions spanning "curation, tokenizer extension, SDG/BYOB, training, conversion, optimization, and evaluation" — several specific capabilities with minor coverage gaps. It is not 5 because only two verbs carry the actions and each domain remains abstract, and not 3 because it goes beyond 1-2 actions to enumerate seven specific domains.

4 / 5

Completeness

The "what" is clear (configure and chain Nemotron steps across seven named domains), but there is no "Use when..." clause or equivalent explicit trigger guidance, which caps completeness at 3 per the judging guideline. It is not 2 because the what is concrete and specific, not vague.

3 / 5

Trigger Term Quality

Terms like "curation", "tokenizer extension", "training", "conversion", "optimization", and "evaluation" are natural user phrasings, giving good keyword coverage. It stays below 5 because "SDG/BYOB" is unexpanded jargon and common trigger phrasings such as "fine-tune", "SFT", "LoRA", or "benchmark" (all of which the skill body handles) are missing from the description.

4 / 5

Distinctiveness Conflict Risk

Anchoring every capability to "repo-native Nemotron steps" establishes a clear niche with distinct triggers, making it very unlikely to fire for unrelated skills. Even closely related model-training skills would not match without the explicit Nemotron repo context.

5 / 5

Total

16

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_field

'metadata' should map string keys to string values

Warning

referenced_paths_exist

Referenced path issues: 4 deeper-than-1-level

Warning

Total

14

/

16

Passed

Repository

NVIDIA-NeMo/Nemotron

Path

skills/nemotron-customize/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.