CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

aws-ai-ml

Selects, deploys, and customizes AI models on Amazon SageMaker. Training or Processing jobs, fine-tuning (SFT/DPO/RLVR/RLAIF), model selection, dataset preparation, evaluation, SageMaker or Bedrock deployment, inference optimization and endpoint diagnostics. Covers the full lifecycle from planning through production. Use when fine-tuning models on SageMaker, choosing which base model to customize, fine-tune, or deploy from SageMaker JumpStart or Hub, SageMakerPublicHub, or the SageMaker public model catalog, transforming or validating training data, evaluating model quality, deploying or optimizing endpoints, configuring IAM/S3 for training, or managing SageMaker Managed MLflow. Use for endpoint health, failures, latency, logs, metrics, errors. Covers Serverless Model Customization, Nova and OSS deployment paths, and PySDK v3. NOT for Ground Truth labeling, Feature Store, or general-purpose AWS infrastructure.

70

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is aws-ai-ml in aws/agent-toolkit-for-aws

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The SKILL.md body is an exemplary router: a clear intent-to-reference table with explicit ordering rules, service-boundary rules, and a strict progressive-disclosure policy, all backed by a real, well-organized bundle. Weaknesses are minor — some verbose routing cells and conditional heuristics that could be tightened — with no validation checkpoints at the top level.

Suggestions

Tighten the longest routing cells (planning, model-selection, endpoint-diagnostics) by deduplicating the repeated trigger phrasing into compact keyword lists.

State the conditional routing heuristics (e.g., 'always activate model-selection for known model names') as short imperative rules rather than multi-sentence prose to improve scanability.

DimensionReasoningScore

Conciseness

The body is a dense routing table plus four terse rules with no explanations of concepts Claude already knows; however, several routing cells repeat the same condition across multiple sentences (e.g., the planning row's long parenthetical enumeration and the model-selection row's repeated ordering prose) that could be trimmed. Not 5: minor padding exists in the longest cells; not 3: the overwhelming majority of tokens carry routing-relevant signal.

4 / 5

Actionability

Every intent maps to a concrete folder path (all verified present in the bundle, e.g. references/planning/, references/model-selection/references/select-for-deployment.md) and the rules include a copy-paste command ('export AWS_SDK_UA_APP_ID=AWSSkill-SageMaker'). Not 5: some routing rules are conditional heuristics ('Always activate model-selection even for known model names') rather than directly executable steps; not 3: the guidance is overwhelmingly concrete and executable for a router skill.

4 / 5

Workflow Clarity

Sequencing is explicit — 'Load this reference FIRST when the request matches multiple rows', 'Always co-activate with other intents', and the recommended use-case-specification → model-selection ordering — giving a clear multi-intent workflow. Not 5: the body itself contains no validation checkpoints or error-recovery loops (these are delegated to the reference folders); not 3: the sequence and ordering rules are clearly and unambiguously defined.

4 / 5

Progressive Disclosure

Textbook progressive disclosure: one routing row per intent pointing to a one-level-deep reference folder, each folder carries its own overview.md for further navigation, and the rule 'Load only the reference folder relevant to the current user intent. Do not load all references at once.' makes the disclosure policy explicit. The bundle listing confirms all 15 referenced folders exist and are well organized.

5 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete capability inventory, explicit 'Use when/Use for' triggers, and clear negative boundaries. The only weakness is a handful of product-internal terms (SageMakerPublicHub, PySDK v3, Serverless Model Customization) that users are unlikely to say verbatim.

Suggestions

Replace or supplement product-internal jargon ('SageMakerPublicHub', 'Serverless Model Customization', 'PySDK v3') with the natural phrasings users would actually type, e.g. 'model catalog', 'serverless fine-tuning', 'SageMaker Python SDK'.

Trim the enumerated near-duplicate trigger lists ('Use when...' vs 'Use for...') into one consolidated trigger clause to reduce padding without losing coverage.

DimensionReasoningScore

Specificity

The description lists many concrete actions — 'Training or Processing jobs, fine-tuning (SFT/DPO/RLVR/RLAIF), model selection, dataset preparation, evaluation, SageMaker or Bedrock deployment, inference optimization and endpoint diagnostics' — giving comprehensive coverage of the lifecycle rather than a vague domain claim.

5 / 5

Completeness

It explicitly answers both 'what' (the opening capability sentences) and 'when' via concrete trigger clauses: 'Use when fine-tuning models on SageMaker, choosing which base model to customize... transforming or validating training data, evaluating model quality, deploying or optimizing endpoints...' and 'Use for endpoint health, failures, latency, logs, metrics, errors.'

5 / 5

Trigger Term Quality

Natural user phrases are well covered ('fine-tuning models on SageMaker', 'deploying or optimizing endpoints', 'endpoint health, failures, latency, logs, metrics, errors', 'transforming or validating training data'), but product-internal jargon like 'SageMakerPublicHub', 'Serverless Model Customization', and 'PySDK v3' is not language users would naturally say, leaving a few natural synonyms missing.

4 / 5

Distinctiveness Conflict Risk

The niche is clear (SageMaker/Bedrock model customization and deployment) and it ends with an explicit negative boundary — 'NOT for Ground Truth labeling, Feature Store, or general-purpose AWS infrastructure' — minimizing conflict with adjacent AWS skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

aws/agent-toolkit-for-aws

Path

plugins/aws-core/skills/aws-ai-ml/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.