CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

tao-run-deft-aoi

Run the full DEFT AOI improvement loop for NVIDIA TAO VisualChangeNet / ChangeNet PCB inspection models: baseline evaluate, RCA, Cosmos AnomalyGen / AMP synthetic defects, k-NN mining, retraining, and deployment gating against a customer-defined primary metric and optional constraints. Use only when the request identifies an AOI / automated-optical-inspection, PCB-defect, VisualChangeNet, or ChangeNet workflow. Supports air-gapped/offline runs with pre-staged assets. Never infer AOI from generic iterative-improvement language. Do not use for CLIP / SigLIP image retrieval, attribute-labelled image data, standalone TAO training, one-off inference, generic anomaly generation, or RCA-only analysis.

Quality

94%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A highly disciplined orchestration body: it treats the loop as a scripted state machine with concrete commands, explicit validation at every stage, and a genuine progressive-disclosure layout over real bundle files. The only deductions are modest cross-section repetition of the gating rules and two path inconsistencies (a missing skill_info.yaml reference and a specs/ vs references/ baseline_spec path mismatch).

Suggestions

Fix the two broken/inconsistent paths: add the missing references/skill_info.yaml (or correct the path in '## Launch Intake'), and align the 'specs/baseline_spec.yaml' citation in '## Base Model' with the actual references/baseline_spec.yaml location used by the reference files.

De-duplicate the gating material: state the single user gate once (Agent Behavior) and have '## Gating' reference it in one line instead of restating the pre-flight/gate/pre-seed rules a third time.

Move the detailed Train AutoML Policy cases (direct docker run vs SDK dispatch) into references/scripts-and-agents.md next to the existing AutoML-policy pitfall, keeping only the one-line rule and the spec-YAML prohibition in SKILL.md.

DimensionReasoningScore

Conciseness

The body is dense and operational with no explanations of concepts Claude already knows, but there is cross-section redundancy: the single user gate is fully specified in the 'Agent Behavior' quote block and restated in '## Gating', and pre-flight / baseline-pre-seed points repeat across 'Execution Contract', 'Workflow', and 'Gating'. This fits the level-4 anchor (efficient, minor trimmable instances) rather than 5, where every token would earn its place.

4 / 5

Actionability

Guidance is copy-paste executable throughout: 'PYTHON=$(bash scripts/deft_python.sh)', '"$PYTHON" scripts/init_deft_state.py', '[ -n "$VAR" ] && echo SET || echo UNSET', 'set -a; source /path/to/.env; set +a', exact mount rules ('$WORKSPACE:/data/workspace'), and even the exact Hydra failure string to recognize. This matches the level-5 anchor of fully executable, specific commands covering the common cases.

5 / 5

Workflow Clarity

The loop is clearly sequenced (Pre-Flight → Baseline → Iterate → Stop → Render) with pervasive validation checkpoints: 'run ""$PYTHON"" scripts/deft_context.py ... before every stage', commit_stage.py verifying required inputs atomically, an enumerated hard-stop list, and an explicit error-recovery feedback loop ('read the final error block ... make one evidence-based correction, and rerun its documented verification'). This matches the level-5 anchor including feedback loops, so the destructive/batch cap does not apply.

5 / 5

Progressive Disclosure

Structure is good: a topic→reference table with contents, a stage→reference→skill mapping, bundled scripts, and just-in-time reading rules; references are one level deep (sibling cross-links only). But '## Launch Intake' directs reading 'references/skill_info.yaml', which does not exist in the bundle, and the body cites 'specs/baseline_spec.yaml' while the file actually lives at 'references/baseline_spec.yaml' — minor organization gaps that fit the level-4 anchor, not 5.

4 / 5

Total

18

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: it states a comprehensive, concrete capability set in third person, gives an explicit positive trigger condition, and closes with an explicit negative-scope list that sharply reduces mis-triggering against sibling TAO skills. Every clause carries discriminating information with no fluff.

DimensionReasoningScore

Specificity

The description enumerates the full concrete action set — 'baseline evaluate, RCA, Cosmos AnomalyGen / AMP synthetic defects, k-NN mining, retraining, and deployment gating against a customer-defined primary metric and optional constraints' — matching the level-5 anchor of multiple specific actions with comprehensive coverage; there are no generic filler phrases.

5 / 5

Completeness

It explicitly answers both what (the enumerated full improvement loop with the metric it optimizes) and when ('Use only when the request identifies an AOI / automated-optical-inspection, PCB-defect, VisualChangeNet, or ChangeNet workflow'), with concrete trigger phrasing — the level-5 example pattern. Not 4, because the 'when' clause is fully explicit rather than improvable.

5 / 5

Trigger Term Quality

Natural trigger terms with synonyms are comprehensive: 'AOI / automated-optical-inspection, PCB-defect, VisualChangeNet, or ChangeNet workflow' plus 'air-gapped/offline', 'synthetic defects', 'RCA', and 'KPI'. This matches the level-5 anchor (synonym coverage); nothing users of this domain would say is missing.

5 / 5

Distinctiveness Conflict Risk

Clear niche (full DEFT AOI loop) with an explicit exclusion list — 'Do not use for CLIP / SigLIP image retrieval, attribute-labelled image data, standalone TAO training, one-off inference, generic anomaly generation, or RCA-only analysis' — minimizing conflict with adjacent skills; this exceeds the level-4 'minor overlap risk' anchor.

5 / 5

Total

20

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

14

/

16

Passed

Repository

NVIDIA/skills

Path

skills/tao-run-deft-aoi/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.