CtrlK
BlogDocsLog inGet started
Tessl Logo

nemo-curator

GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.

68

Quality

82%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

65%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable with concrete code and a well-sequenced pipeline, but it is weakened by redundant benchmark/marketing content, missing validation checkpoints for batch operations, and inline material that belongs in references. Solid but improvable on token efficiency and structure.

Suggestions

Move the Performance benchmarks, Cost comparison, and multimodal (image/video/audio) curation sections into reference files to cut inline bulk and redundancy.

Add validation/checkpoint steps to the curation pipeline (e.g., verify row counts or sample output after each stage), since these are batch operations that currently lack feedback loops.

De-duplicate the GPU speedup figures that appear in both the 'GPU vs CPU performance' table and the 'Performance benchmarks' section.

DimensionReasoningScore

Conciseness

The body is largely dense and actionable, but the '16×' speedup appears in both the 'GPU vs CPU performance' table and the 'Performance benchmarks' section, and marketing-style cost/TCO content ('40% lower TCO', '89% reduction') inflates it beyond what earns its place.

2 / 3

Actionability

Concrete, copy-paste-ready code throughout — install commands, full Stage 1–4 pipelines, and multimodal examples — with only minor `(...)` placeholders that do not undermine executability.

3 / 3

Workflow Clarity

Stages are clearly sequenced (Stage 1–4 and the ordered Common Crawl pipeline list), but no validation or verification checkpoints appear for these batch curation operations, capping the score at 2 per the batch-operations guideline.

2 / 3

Progressive Disclosure

Two real one-level-deep references (filtering.md, deduplication.md) are clearly signaled, but the Performance benchmarks, Cost comparison, and multimodal curation sections remain inline rather than split into reference files.

2 / 3

Total

9

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concrete, third-person, and explicitly pairs capabilities with a 'Use for...' trigger clause, hitting the top anchor on every dimension. It is distinguishable and free of vague fluff or over-claims.

DimensionReasoningScore

Specificity

Lists multiple specific concrete actions — 'fuzzy deduplication', 'quality filtering', 'semantic deduplication', 'PII redaction', 'NSFW detection' — matching the score-3 anchor.

3 / 3

Completeness

Clearly answers what (curation, dedup, filtering, PII, NSFW) and when via an explicit 'Use for...' clause, satisfying both halves required for a 3.

3 / 3

Trigger Term Quality

Natural terms users would say appear in 'Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora', giving good coverage of common request phrasings.

3 / 3

Distinctiveness Conflict Risk

A clear niche — GPU-accelerated LLM data curation with RAPIDS — with distinct triggers unlikely to overlap with unrelated skills.

3 / 3

Total

12

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository
synthetic-sciences/openscience
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.