CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

aws-ai-ml

Selects, deploys, and customizes AI models on Amazon SageMaker. Training or Processing jobs, fine-tuning (SFT/DPO/RLVR/RLAIF), model selection, dataset preparation, evaluation, SageMaker or Bedrock deployment, inference optimization and endpoint diagnostics. Covers the full lifecycle from planning through production. Use when fine-tuning models on SageMaker, choosing which base model to customize, fine-tune, or deploy from SageMaker JumpStart or Hub, SageMakerPublicHub, or the SageMaker public model catalog, transforming or validating training data, evaluating model quality, deploying or optimizing endpoints, configuring IAM/S3 for training, or managing SageMaker Managed MLflow. Use for endpoint health, failures, latency, logs, metrics, errors. Covers Serverless Model Customization, Nova and OSS deployment paths, and PySDK v3. NOT for Ground Truth labeling, Feature Store, or general-purpose AWS infrastructure.

77

Quality

97%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary router-style SKILL.md: a 14-row intent table pointing to a well-organized, verified 17-topic reference tree, plus crisp boundary rules with one concrete command. The single weakness is verbosity in the longest routing cells (planning, model-selection, deployment), which restate conditions and could be trimmed by roughly a third without losing routing information.

Suggestions

Tighten the planning and model-selection routing cells: state the use-case-specification recommendation once (e.g., 'Route to use-case-specification first unless the user provides a model name/ID or declines') instead of the current recommended-then-qualified double statement.

Split the overloaded deployment row's sub-workflow triggers into shorter phrases, or move the plain-deploy vs benchmarking vs recommendations distinction into the model-deployment overview and keep only the routing trigger in the table.

Add one line noting the folder convention (each topic folder begins with overview.md, with deeper references/, scripts/, code_templates/ inside) so first-time navigation needs no folder exploration.

DimensionReasoningScore

Conciseness

The body is a lean router with no explanation of concepts Claude already knows — intro sentence, routing table, four rules. However, several routing cells are wordy: the planning cell runs ~90 words, and the model-selection cell states the use-case-specification recommendation twice ('**Recommended:** route to use-case-specification first... Routing to use-case-specification first is not required if user provides a specific model name/ID or declines'). This fits anchor 4, 'Efficient; minor instances of over-explanation that could be trimmed', rather than 5, since those cells could be tightened without losing routing content.

4 / 5

Actionability

Every routing row maps a concrete user utterance to a specific verified path (all 14 referenced folders exist on disk), the model-selection row pins a specific file ('Base model filtering for deployment MUST go through select-for-deployment.md and its scripts'), and the rules include a copy-paste command ('export AWS_SDK_UA_APP_ID=AWSSkill-SageMaker'). For an instruction-only routing skill this is fully actionable; matches anchor 5 under the code_vs_instruction_skills note.

5 / 5

Workflow Clarity

Sequencing is explicit: 'Load this reference FIRST when the request matches multiple rows', 'Requires a base model to be selected first', and ambiguity gates such as 'model-selection MUST confirm which path before proceeding' and 'ask one service-choice question. Do not select a service by default.' This is a single-purpose router under 50 lines whose single action is unambiguous with explicit decision checkpoints, meeting the simple-skill exception for a 5; no destructive/batch cap applies.

5 / 5

Progressive Disclosure

Scored against the actual bundle: SKILL.md is a clean overview whose only content is intent-to-folder routing, all 14 linked paths are real, and each of the 17 topic folders leads with a substantive overview.md (verified 98–171 lines of real routing rules and prerequisites, not pointer-chains) that in turn signals its own references/, scripts/, and code_templates/. Content is appropriately split across 117 files with nothing inlined that belongs in a reference, matching anchor 5, 'Clear overview with well-signaled... references; content appropriately split; easy navigation'.

5 / 5

Total

19

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A dense, high-quality description: third-person voice, comprehensive concrete capabilities, explicit 'Use when'/'Use for' trigger phrases with synonyms, and explicit exclusions. Its only weakness is verbosity — at ~130 words with some restatement (e.g., 'customize, fine-tune, or deploy' appearing in multiple clauses), it could be tightened without losing triggers, but every clause is informational rather than fluff.

DimensionReasoningScore

Specificity

Third-person verbs ('Selects, deploys, and customizes AI models on Amazon SageMaker') introduce an enumeration of concrete actions: 'Training or Processing jobs, fine-tuning (SFT/DPO/RLVR/RLAIF), model selection, dataset preparation, evaluation, SageMaker or Bedrock deployment, inference optimization and endpoint diagnostics' — comprehensive coverage of the domain with named techniques. This matches the anchor 'Lists multiple specific concrete actions; comprehensive coverage' rather than 4, since no capability area of the lifecycle is visibly missing.

5 / 5

Completeness

Both questions are answered explicitly: 'what' via the opening capability enumeration and 'when' via the concrete 'Use when fine-tuning models on SageMaker, choosing which base model to customize...' trigger list plus a second 'Use for endpoint health, failures...' clause. This matches the anchor 'Clearly and explicitly answers both what AND when with concrete trigger phrases'; not 4, because the when-clause is fully explicit rather than merely present.

5 / 5

Trigger Term Quality

Natural user phrasings are comprehensively covered with synonyms: 'fine-tuning models on SageMaker', 'choosing which base model to customize, fine-tune, or deploy from SageMaker JumpStart or Hub, SageMakerPublicHub, or the SageMaker public model catalog', 'transforming or validating training data', 'evaluating model quality', 'deploying or optimizing endpoints', 'configuring IAM/S3 for training', and 'endpoint health, failures, latency, logs, metrics, errors'. Matches the anchor 'Comprehensive coverage of natural terms including synonyms'; no common variant (train, deploy, benchmark, diagnose) is missing.

5 / 5

Distinctiveness Conflict Risk

The niche (SageMaker model customization) is distinct and the explicit negative boundary 'NOT for Ground Truth labeling, Feature Store, or general-purpose AWS infrastructure' plus the service boundary (SageMaker vs Bedrock) minimizes wrong-skill triggering. Matches the anchor 'Clear niche with distinct triggers; minimal conflict risk'.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

aws/agent-toolkit-for-aws

Path

skills/core-skills/aws-ai-ml/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.