CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-model-serving

Databricks Model Serving endpoint lifecycle and ops. Use when asked to: CRUD serving endpoints (CLI or MLflow Deployments client); configure traffic routing for A/B / canary deploys and zero-downtime version swaps; retrieve OpenAPI schemas; inspect logs, metrics, or permissions; manage legacy AI Gateway rate limits (not Unity Gateway); discover Foundation Model API endpoints at runtime; integrate endpoints into Databricks Apps; or stream from off-platform clients (Vercel AI SDK v6, standalone Node.js). NOT for: Unity Gateway CRUD and management (databricks-unity-gateway), training, MLflow autologging, UC registration, custom PyFunc/ResponsesAgent authoring (databricks-ml-training); no-code document / data agents incl. legacy Knowledge Assistants & Supervisor Agents (databricks-genie-agents); MLflow evaluation (databricks-mlflow-evaluation).

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is databricks-model-serving in databricks/databricks-agent-skills

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, highly actionable ops skill: executable commands with complete JSON specs, explicit dual-field readiness validation, common-failure callouts, and a well-managed one-level-deep reference for off-platform streaming. The main improvement opportunities are tightening small redundancies, moving the Apps-integration and MLflow-client detail into references, and adding a verification/caution step around the destructive delete command.

Suggestions

Trim the CLI Discovery section: the paragraph after the code block repeats the same 'run -h before constructing any command' instruction verbatim in spirit — keep one form.

Move the Apps integration walkthrough (manifest/init commands and databricks.yml/app.yaml snippets) into the databricks-apps skill or a local reference, keeping only the pointer in SKILL.md.

Add validation guidance for the destructive 'delete' operation in the Other Commands table (e.g., confirm the endpoint name via 'get' and check for dependent Apps/jobs before deleting).

DimensionReasoningScore

Conciseness

The body is dense with Databricks-specific gotchas Claude would not know (entity-name derivation from 'served_entities[].name', 'state.ready' vs 'state.config_update', UIMessage-to-CoreMessage conversion in the reference) rather than generic explanations, fitting the score-4 anchor 'efficient; minor instances of over-explanation'. Not a 5 because of small redundancies: the CLI Discovery section restates the same '-h' instruction in both the code block and the immediately following paragraph, and the one-line background sentence 'Model Serving provides managed endpoints...' plus parts of the Apps integration YAML add tokens without new capability.

4 / 5

Actionability

Fully executable, copy-paste-ready guidance throughout: complete 'create' JSON with traffic_config, query examples for both chat ('messages' array) and classical-ML ('dataframe_records') endpoints, a jq readiness-polling one-liner, a full runnable Python zero-downtime-swap script, the FM API runtime-discovery jq filter, and a troubleshooting table with exact commands. This matches the score-5 anchor 'specific examples cover the common cases'; the score-4 anchor's 'minor gaps' does not apply.

5 / 5

Workflow Clarity

The core workflows have explicit validation checkpoints: readiness polling is elevated to 'Poll both' state.ready AND state.config_update with the mid-swap false-'ready' failure mode explained, and the version swap names the exact common bug (alias-only vs update-only). This fits the score-4 anchor 'clear sequence with most checkpoints present; minor validation gaps' — the gap being that 'delete <NAME>' appears in the command table with no caution or verification guidance (a destructive operation), and error-recovery loops live in the troubleshooting table rather than inline in the workflows, keeping it below the score-5 anchor's 'feedback loops for error recovery' embedded in the sequence itself.

4 / 5

Progressive Disclosure

Good structure: the off-platform streaming material is correctly split into references/off-platform-streaming.md (verified to exist, one level deep, clearly signaled with a descriptive link and scope statement), headers make navigation easy, and cross-skill pointers (databricks-apps, databricks-ml-training, databricks-unity-gateway, parent databricks-core) are explicit. Falls short of the score-5 anchor because secondary material is still inlined in the body — the Apps integration section (~40 lines of scaffolding commands and YAML) and the MLflow Deployments client details sit in SKILL.md even though the body itself defers the full pattern to the databricks-apps skill, a 'minor organization gap' matching score 4.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary skill description: concrete capability enumeration, an explicit 'Use when asked to' trigger list, and a 'NOT for' boundary clause that routes adjacent workloads to sibling skills. The only meaningful gap is that query/invoke-style trigger phrasings are absent despite querying being a core body capability.

DimensionReasoningScore

Specificity

The description lists eight-plus concrete actions — 'CRUD serving endpoints (CLI or MLflow Deployments client)', 'configure traffic routing for A/B / canary deploys and zero-downtime version swaps', 'retrieve OpenAPI schemas', 'inspect logs, metrics, or permissions', 'manage legacy AI Gateway rate limits' — comprehensively covering the skill's scope. This matches the score-5 anchor ('multiple specific concrete actions; comprehensive coverage') and exceeds score 4 because no meaningful capability area of the skill body is missing.

5 / 5

Completeness

Explicitly answers both questions: 'what' ('Databricks Model Serving endpoint lifecycle and ops' plus the enumerated capability list) and 'when' ('Use when asked to: CRUD serving endpoints... integrate endpoints into Databricks Apps; or stream from off-platform clients'), with concrete trigger phrases. This is a direct match for the score-5 anchor; the score-4 anchor ('when could be more explicit') does not apply since the when-clause is a detailed enumerated list.

5 / 5

Trigger Term Quality

Strong natural terms users would say: 'serving endpoints', 'canary deploys', 'zero-downtime', 'logs, metrics, or permissions', 'rate limits', 'Databricks Apps', 'stream'. Falls short of the score-5 anchor ('comprehensive coverage... including synonyms') because common user phrasings like 'query/invoke/test an endpoint', 'deploy a model', and 'inference' are absent even though querying is a major section of the skill body — but coverage is clearly above the score-3 anchor's 'missing common variations'.

4 / 5

Distinctiveness Conflict Risk

Clear niche with explicit disambiguation: a 'NOT for:' clause routing Unity Gateway to databricks-unity-gateway, training/PyFunc authoring to databricks-ml-training, no-code agents to databricks-genie-agents, and MLflow evaluation to databricks-mlflow-evaluation, plus the '(not Unity Gateway)' qualifier on AI Gateway rate limits. Minimal conflict risk, matching the score-5 anchor; well above score 4's 'minor overlap risk'.

5 / 5

Total

19

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 2 suspicious

Warning

Total

14

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

plugins/databricks/claude/skills/databricks-model-serving/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.