CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

nemo-curator

GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.

64

Quality

80%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./cli-tool/components/skills/ai-research/data-processing-nemo-curator/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

61%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, code-heavy skill with good progressive disclosure and mostly executable examples. The main weaknesses are redundant performance/cost marketing repeated across multiple sections, absence of any validation or verification steps in what is destructive batch processing of large corpora, and a pipeline example whose filter/module invocation pattern is inconsistent with the rest of the document.

Suggestions

Add validation checkpoints to the pipeline workflows (e.g., sample filtered output, compare record counts before/after dedup, verify parquet write) — batch curation with no verification currently caps workflow clarity.

Consolidate the performance table, 'Performance benchmarks', and 'Cost comparison' sections into one section and drop promotional filler ('⭐ 500+', '40% lower TCO') to cut ~40 lines of redundancy.

Fix the Common Crawl pipeline example so every stage is invoked consistently (filters via ScoreFilter/dataset.filter, modules via direct call) and replace the 'FuzzyDuplicates(...)' ellipses with real parameters; move detailed filter/dedup parameter code out of SKILL.md into the existing reference files instead of duplicating it in both places.

DimensionReasoningScore

Conciseness

The body is mostly lean code, but the same performance numbers appear four times ('16× faster' in the intro, the GPU vs CPU table, the 'Performance benchmarks' section, and the 'Cost comparison' section), plus promotional padding ('40% lower TCO', '⭐ 500+', '89% reduction'). This duplication could be consolidated into one section, fitting 'mostly efficient but includes some unnecessary content that could be tightened' rather than the 'minor trim' level above.

3 / 5

Actionability

Mostly executable, concrete code for each pipeline stage and modality, but there are gaps: 'FuzzyDuplicates(...)' ellipsis placeholders appear twice in the multi-GPU/distributed sections, and the Common Crawl pipeline example mixes filter objects and modules in one list called via 'stage(dataset)' even though filters were previously shown requiring 'dataset.filter(...)', which would not run as written. Falls between 'some concrete guidance but incomplete' and fully executable — noticeably above the midpoint.

4 / 5

Workflow Clarity

The 'Data curation pipeline' section clearly sequences four stages and the Common Crawl pattern orders them cost-effectively, but this is batch data processing over large corpora with no validation checkpoints anywhere (no output sampling, record-count checks, or verify steps before writing 'curated_data/'). Per the rubric, batch operations missing validation cap at 3.

3 / 5

Progressive Disclosure

Good structure: a References section signals one-level-deep links to references/filtering.md and references/deduplication.md, both of which exist. However, the split is not clean — Stage 1/2 code in the body is nearly duplicated inside those reference files rather than delegated, and the full multimodal sections stay inline. Fits 'good structure; minor organization gaps' rather than 'content appropriately split'.

4 / 5

Total

14

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete capability list, explicit 'Use for...' trigger guidance, and a distinct niche. The only gap is keyword breadth — a few natural user phrasings (e.g., web scrapes, Common Crawl) are absent while tool-specific jargon (RAPIDS) is present.

DimensionReasoningScore

Specificity

The description lists multiple concrete capabilities — 'fuzzy deduplication (16× faster)', 'quality filtering (30+ heuristics)', 'semantic deduplication', 'PII redaction', 'NSFW detection' — giving comprehensive coverage of what the skill does, matching the top anchor rather than the 'minor gaps' level below.

5 / 5

Completeness

Both 'what' (GPU-accelerated data curation with named features) and 'when' are explicitly answered: 'Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora' is a concrete trigger clause, matching the top anchor; not score 4 since the 'when' clause is already explicit and specific.

5 / 5

Trigger Term Quality

Good natural keywords like 'deduplicating large corpora', 'cleaning web data', 'training datasets', 'PII redaction', but misses common synonyms and concrete artifacts users might mention (e.g., 'Common Crawl', 'parquet', 'web scrape'), and leans on jargon like 'RAPIDS'. Fits 'good keyword coverage; a few natural terms missing' rather than comprehensive synonym/extension coverage.

4 / 5

Distinctiveness Conflict Risk

It carves a clear niche (GPU-accelerated LLM training-data curation) with distinct triggers like deduplication, PII redaction, and NSFW detection, giving minimal overlap risk with generic data-processing skills.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

davila7/claude-code-templates

Path

cli-tool/components/skills/ai-research/data-processing-nemo-curator/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.