CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-ml-training

Train ML models on Databricks. Use for: classification/regression/deep-learning (XGBoost, scikit-learn, LightGBM, PyTorch) with Optuna, @prod/@challenger aliases, batch scoring (spark_udf for plain models, fe.score_batch for feature-store-backed), custom PyFunc, custom ResponsesAgent (LangGraph + UC Function/Vector Search); UC feature tables + FeatureLookup + point-in-time joins + Lakebase online store; declarative Feature Views (create_feature, DeltaTableSource, RollingWindow/SlidingWindow/TumblingWindow, materialize_features, streaming Kafka features). NOT for: endpoint ops (databricks-model-serving), MLflow evaluation (databricks-mlflow-evaluation).

72

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, well-engineered body: fully executable code, explicit validation and error-recovery in the job workflow, and clean one-level-deep progressive disclosure into verified reference files. The only improvements are token-level: trim the repeated spark_udf/score_batch caveat and add a validation checkpoint around the overwrite-mode batch write.

DimensionReasoningScore

Conciseness

The body is dense with non-obvious traps and decision rules ("Stages are deprecated — UC uses movable aliases", "use the TASK run_id (tasks[0].run_id) — NOT the submit run_id", "client: 4 is required on serverless notebook tasks") and assumes Claude's competence with MLflow/CLI basics. Minor trimmable redundancy exists — the spark_udf vs fe.score_batch caveat is repeated three times — placing it at the 'efficient, minor instances could be trimmed' anchor rather than the lean 5.

4 / 5

Actionability

All guidance is copy-paste ready: a complete Databricks-source-format notebook with Optuna HPO, registration, and alias promotion; a full bash jobs-submit with pinned dependency spec, jq-parsed run IDs, polling, and cancel-on-timeout; and concrete scoring code with env_manager guidance. Specific examples cover the common cases, matching the fully-executable anchor.

5 / 5

Workflow Clarity

The canonical-flow diagram plus the job section give a clear sequence with explicit checkpoints: poll to terminal life_cycle_state, require result_state == SUCCESS with cancel-run and exit 1 on timeout, then pull structured output via the TASK run_id. A minor validation gap remains — the batch-scoring path writes with .mode("overwrite") to a gold table with no checkpoint on the scored output — so it sits at the 'most checkpoints present' anchor rather than 5.

4 / 5

Progressive Disclosure

The body is an overview that appropriately splits large detail into four real, one-level-deep reference files (custom-pyfunc.md, genai-agents.md, feature-store.md, feature-views.md — all verified to exist, including the referenced genai-agents.md#resources-that-need-passthrough-auth anchor), each clearly signaled with a purpose statement in a Reference files table plus inline pointers and cross-links to sibling skills. This matches the clear-overview anchor exactly.

5 / 5

Total

18

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An excellent description: it states what the skill does, when to use it with concrete triggers, and what it does not cover via explicit sibling-skill delegation. Its only weakness is that a large share of the keyword density is API jargon rather than natural user phrasing, which slightly weakens trigger-term quality.

DimensionReasoningScore

Specificity

The description lists many specific concrete actions with API-level detail — "classification/regression/deep-learning (XGBoost, scikit-learn, LightGBM, PyTorch) with Optuna", "batch scoring (spark_udf for plain models, fe.score_batch for feature-store-backed)", "custom PyFunc", "custom ResponsesAgent (LangGraph + UC Function/Vector Search)", "FeatureLookup + point-in-time joins", "RollingWindow/SlidingWindow/TumblingWindow". Coverage spans the skill's entire surface with no notable gaps, matching the comprehensive-coverage anchor rather than the 'minor gaps' anchor below it.

5 / 5

Completeness

It explicitly answers what ("Train ML models on Databricks") and when ("Use for: classification/regression/deep-learning...") with concrete trigger phrases, and adds an explicit NOT-for boundary ("NOT for: endpoint ops (databricks-model-serving), MLflow evaluation"). This matches the top anchor, mirroring the presentation-style good example.

5 / 5

Trigger Term Quality

Good natural keyword coverage ("Train ML models", "classification", "regression", "XGBoost", "PyTorch", "feature store", "batch scoring") with framework synonyms. However much of the density is API jargon users would not naturally say ("RollingWindow/SlidingWindow/TumblingWindow", "DeltaTableSource", "materialize_features") and natural phrasings like "MLflow", "register a model", or "hyperparameter tuning" appear only implicitly, so it fits the 'good coverage, a few natural terms missing' anchor rather than the comprehensive-synonyms anchor.

4 / 5

Distinctiveness Conflict Risk

Clear niche (ML training on Databricks) with an explicit NOT-for clause delegating endpoint ops and MLflow evaluation to sibling skills, which minimizes mis-trigger risk. Distinct framework/API triggers (Optuna, @prod/@challenger, FeatureLookup) further separate it from adjacent skills.

5 / 5

Total

19

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 12 suspicious

Warning

Total

14

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

plugins/databricks/claude/skills/databricks-ml-training/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.