CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-model-serving

Databricks Model Serving endpoint lifecycle and ops. Use when asked to: CRUD serving endpoints (CLI or MLflow Deployments client); configure traffic routing for A/B / canary deploys and zero-downtime version swaps; retrieve OpenAPI schemas; inspect logs, metrics, or permissions; manage legacy AI Gateway rate limits (not Unity Gateway); discover Foundation Model API endpoints at runtime; integrate endpoints into Databricks Apps; or stream from off-platform clients (Vercel AI SDK v6, standalone Node.js). NOT for: Unity Gateway CRUD and management (databricks-unity-gateway), training, MLflow autologging, UC registration, custom PyFunc/ResponsesAgent authoring (databricks-ml-training); Knowledge Assistants/Supervisor Agents (databricks-agent-bricks); MLflow evaluation (databricks-mlflow-evaluation).

73

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality ops skill body: executable commands with complete JSON specs throughout, explicit readiness validation with a documented failure mode, conditional workflows, and an appropriately split single reference file. The only weakness is minor token redundancy (restated discovery instructions and a redundant structure diagram) that keeps it just short of maximally lean.

DimensionReasoningScore

Conciseness

The body is dense with Databricks-specific knowledge Claude cannot know (traffic_config route naming, dual state polling, tags-as-top-level-kwarg, the Serving UI 'Owned by me' filter gotcha) and assumes CLI/JSON competence. It falls short of 5 due to minor trimmable redundancy: the CLI-discovery instruction is stated twice ('Run databricks serving-endpoints -h before constructing any command. Run databricks serving-endpoints <subcommand> -h...' immediately restates the preceding code block), and the ASCII endpoint-structure tree restates facts already covered in the bullets below it.

4 / 5

Actionability

Every section is copy-paste ready: a complete `create` command with full JSON spec, executable `query` examples for both chat and classical-ML payloads, a jq readiness-extraction pipeline, a complete Python zero-downtime-swap script, a jq filter for runtime FM API discovery, and a troubleshooting table keyed to exact error strings and commands. This matches the 5 anchor ('fully executable; covers the common cases'), not 4, since even the gotchas come with concrete remediation commands.

5 / 5

Workflow Clarity

Multi-step processes are explicitly sequenced with validation checkpoints: create → poll with the dual check 'Fully ready when ready == "READY" AND config_update == "NOT_UPDATING"' (including the trap of polling only state.ready mid version-swap); the swap workflow spells out that omitting either the alias repoint or update_endpoint 'is the common bug'; the App integration flow is a conditional Step 1 / Step 2. The Troubleshooting table supplies feedback loops (error → diagnose → fix), matching the 5 anchor. The destructive-cap guidance does not apply: delete appears only as a one-line table row, not as an unvalidated destructive workflow.

5 / 5

Progressive Disclosure

Against the actual bundle: the single reference file (references/off-platform-streaming.md, 182 lines) is real, clearly signaled with a descriptive link ('For apps deployed outside Databricks Apps (Vercel, AWS, standalone Node.js)... see [references/off-platform-streaming.md]'), one level deep, and correctly split out of the core ops body. Cross-skill pointers (databricks-apps model-serving guide, databricks-ml-training, databricks-unity-gateway) are all explicitly named with rationale. The body's well-headed sections plus this clean split match the 5 anchor, not 4, since there is no inline content that clearly belongs in a separate file.

5 / 5

Total

19

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: concrete action inventory, explicit 'Use when asked to' triggers, third-person voice, and an explicit NOT-for boundary against sibling skills. The only gap is a handful of natural trigger terms (notably querying/scoring an endpoint) that keep trigger coverage short of comprehensive.

DimensionReasoningScore

Specificity

The description lists many concrete actions — 'CRUD serving endpoints (CLI or MLflow Deployments client)', 'configure traffic routing for A/B / canary deploys and zero-downtime version swaps', 'retrieve OpenAPI schemas', 'inspect logs, metrics, or permissions', 'manage legacy AI Gateway rate limits', 'discover Foundation Model API endpoints at runtime', 'integrate endpoints into Databricks Apps', 'stream from off-platform clients' — giving comprehensive lifecycle coverage, matching the 5 anchor. It is not below 4 because coverage spans creation, routing, inspection, governance, discovery, integration, and streaming rather than leaving minor gaps. Third-person voice is used throughout (no first/second person penalty applies).

5 / 5

Completeness

It explicitly answers both: what — 'Databricks Model Serving endpoint lifecycle and ops'; and when — an explicit 'Use when asked to:' clause enumerating nine concrete trigger scenarios plus a 'NOT for:' exclusion list. This clearly matches the 5 anchor ('both what AND when with concrete trigger phrases'), not 4, because the 'when' is exhaustive and granular rather than merely adequate.

5 / 5

Trigger Term Quality

Natural trigger phrasing is strong: 'serving endpoints', 'A/B', 'canary deploys', 'zero-downtime', 'logs, metrics, or permissions', 'rate limits', 'Foundation Model API endpoints', 'Databricks Apps', 'stream', 'Vercel AI SDK v6'. It sits at 4 rather than 5 because a few natural user phrasings are absent — most notably 'query'/'score' an endpoint (the most common user ask, covered in the body but not the description) and terms like 'scale to zero' or 'test the endpoint'.

4 / 5

Distinctiveness Conflict Risk

The niche is unambiguous (Databricks Model Serving endpoints) and it defuses the highest-risk overlaps explicitly: 'manage legacy AI Gateway rate limits (not Unity Gateway)' and a NOT-for list naming sibling skills (databricks-unity-gateway, databricks-ml-training, databricks-agent-bricks, databricks-mlflow-evaluation). Minimal conflict risk, matching the 5 anchor.

5 / 5

Total

19

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 2 suspicious

Warning

Total

14

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

skills/databricks-model-serving/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.