CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-ai-functions

Use Databricks built-in AI Functions (ai_classify, ai_decide, ai_extract, ai_summarize, ai_mask, ai_translate, ai_fix_grammar, ai_gen, ai_analyze_sentiment, ai_similarity, ai_parse_document, ai_prep_search, ai_query, ai_forecast) to add AI capabilities directly to SQL and PySpark pipelines without managing model endpoints. Also covers document parsing and building custom RAG pipelines (parse → prep_search → index → query).

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is databricks-ai-functions in databricks/databricks-agent-skills

SKILL.md
Quality
Evals
Security

Quality

Content

96%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary reference-style skill body: executable examples, per-function deep links into three real reference files, a staged batch pipeline with error handling at every stage, and a practical troubleshooting table, all with essentially no token waste. The only blemishes are minor navigation gaps — cross-skill links that don't resolve within this bundle and two unexplained asset files.

DimensionReasoningScore

Conciseness

Lean and dense throughout — a signature/prereq table, five tight SQL patterns, a staged pipeline, and a troubleshooting table, with zero padding; it assumes competence (no "what is an LLM/Databricks" intro) and every row and code block carries operational payload. Not 4 because the few orientation clauses ("operate on table columns as naturally as UPPER() or LENGTH()") are load-bearing mental-model info, not over-explanation; version numbers (DBR 17.3/18.2) are prerequisites, not time-conditional API guidance.

5 / 5

Actionability

All examples are copy-paste-ready, executable Databricks SQL with real syntax — named arguments (map('version','2.0'), failOnError => false, responseFormat => ...), VARIANT colon-access (:response:product::STRING), variant_get + LATERAL VIEW explode, TABLE(SELECT ...) for ai_forecast — plus a working PySpark expr() one-liner and concrete fixes in the Common Issues table. Not 4 because the examples collectively cover the common cases (classify/extract/mask/similarity/forecast/RAG) with no pseudocode or placeholder gaps.

5 / 5

Workflow Clarity

The document pipeline is explicitly staged (parse → classify → extract) with validation at each checkpoint — parse errors filtered (WHERE parsed:error_status IS NULL), per-row extract_error and ai_query errorMessage surfaced, and batch-error routing to a sidecar table instead of crashing — satisfying the batch-operation validation requirement. Not 4 because checkpoints are explicit at every stage and the Common Issues table provides an error-recovery map on top; the batch cap does not apply since validation is present throughout.

5 / 5

Progressive Disclosure

Good structure: the Overview table deep-links each function to its anchor in the three real one-level-deep reference files, and an explicit Reference Files section describes each — but checked against the actual bundle, three referenced paths (../databricks-vector-search/SKILL.md, ../databricks-genie-agents/SKILL.md, ../databricks-model-serving/SKILL.md) do not resolve, and assets/databricks.png|svg are never referenced or explained anywhere. Not 5 because those dangling cross-bundle links and orphaned assets are exactly the 'minor organization gaps' of the anchor-4 example; not 3 because all in-bundle references exist, are one level deep, and are clearly signaled.

4 / 5

Total

19

/

20

Passed

Description

75%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A highly specific, well-differentiated description that names the full function inventory and both integration surfaces (SQL and PySpark). Its one structural weakness is the missing "Use when..." trigger clause, which caps completeness and leaves activation guidance implicit.

Suggestions

Add an explicit trigger clause, e.g. "Use when working in Databricks SQL or PySpark and the user wants LLM tasks (classification, extraction, summarization, PII masking, translation, sentiment) applied to table columns, or when building a RAG/document pipeline on Databricks."

Express a few capabilities as natural synonyms rather than only function names — e.g. mention "PII redaction/masking" for ai_mask, "semantic similarity/dedup" for ai_similarity, and "time-series forecasting" for ai_forecast — so users who don't know the function names still match.

Trim the exhaustive 14-function parenthetical to the most common 5–6 and let the body's table carry the rest; the saved tokens can fund the "Use when" clause without net growth.

DimensionReasoningScore

Specificity

Enumerates all 14 concrete function names (ai_classify, ai_extract, ai_parse_document, ai_forecast, ...) plus concrete actions — "add AI capabilities directly to SQL and PySpark pipelines without managing model endpoints", "document parsing", "building custom RAG pipelines (parse → prep_search → index → query)" — matching the comprehensive-coverage anchor. Not 4 because coverage of the domain's capabilities is complete, not 'several with minor gaps'.

5 / 5

Completeness

The "what" is clear (built-in AI Functions for SQL/PySpark pipelines, document parsing, RAG pipelines) but there is no "Use when..." clause or equivalent explicit trigger guidance anywhere — per the judging guidelines this caps completeness at 3. Not 4 because the "when" is entirely absent rather than merely imprecise.

3 / 5

Trigger Term Quality

Good natural-term coverage: users would say "classify", "summarize", "translate", "sentiment", "forecast", "RAG", "SQL", "PySpark", plus exact function names. Not 5 because common synonyms like "PII redaction" (ai_mask), "sentiment analysis", "chunking", or "semantic similarity" are never spoken as natural phrases, only as function identifiers.

4 / 5

Distinctiveness Conflict Risk

"Databricks built-in AI Functions" with 14 named functions is a clear niche with distinct triggers; a user asking about ai_classify or ai_parse_document would unambiguously land here rather than a generic SQL or model-serving skill. Not 4 because no meaningful overlap risk remains — the function names themselves are the discriminators.

5 / 5

Total

17

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 3 suspicious

Warning

Total

14

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

plugins/databricks/antigravity/skills/databricks-ai-functions/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.