CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-mlflow-evaluation

MLflow 3 GenAI agent evaluation. Use when writing mlflow.genai.evaluate() code, creating @scorer functions, using built-in scorers (Guidelines, Correctness, Safety, RetrievalGroundedness), building eval datasets from traces, setting up trace ingestion and production monitoring, aligning judges with MemAlign from domain expert feedback, or running optimize_prompts() with GEPA for automated prompt improvement.

70

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

Excellent router-style SKILL.md: concise, well-structured, with goal-based workflow tables that point precisely into a real, verified reference bundle. Actionability and workflow clarity are strong but rely on delegation to reference files rather than inline code or explicit validation steps in the body itself.

DimensionReasoningScore

Conciseness

The body is a lean router/index: no concept explanations, no tutorials, no filler — just a scope statement, two mandatory pre-read directives, eight step-tables, a quick-lookup table, and a dense 'Critical API Facts' list (e.g., 'Use mlflow.genai.evaluate() (NOT mlflow.evaluate())', 'optimize_prompts: Requires MLflow >= 3.5.0'). Every line is navigation or a non-obvious gotcha; it fully assumes Claude's competence.

5 / 5

Actionability

Every workflow step names the exact reference file and pattern/journey number to read (verified to exist: patterns-datasets.md Patterns 16-17, user-journeys.md Journey 0/10, GOTCHAS.md 'Custom Judge Model Format' anchor all resolve), and Critical API Facts gives concrete, executable specifics like the required data format '{"inputs": {"query": "..."}}' and predict_fn kwargs semantics. Not a 5 because the body itself contains no copy-paste code or commands — that material is delegated to CRITICAL-interfaces.md and the patterns files, which is appropriate for a router but leaves minor gaps if read in isolation.

4 / 5

Workflow Clarity

Eight goal-indexed workflows with explicit numbered step tables, each mapping to a specific reference section (e.g., Workflow 6: link UC schema -> set destination -> instrument -> configure sources -> enable monitoring -> query). Checkpoint-like steps exist ('Re-evaluate to measure impact', 'promote conditionally', 'Register aligned judge... baseline'). Not a 5 because validation/error-recovery checkpoints are not spelled out in the body — they live in the referenced files — and these are read/run workflows rather than destructive operations, so the destructive-cap does not apply.

4 / 5

Progressive Disclosure

Textbook progressive disclosure: SKILL.md is a pure overview routing to 11 one-level-deep reference files, all of which exist in the bundle, with a Quick Lookup table giving purpose and 'When to Read' guidance per file, mandatory-first reads flagged ('Always read first'), and pattern/journey pointers that verifiably resolve. No nesting beyond one level, no orphan references, no inlined bulk content.

5 / 5

Total

18

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete, comprehensive, third-person, with an explicit 'Use when...' trigger clause enumerating exact APIs and workflows. The only weaknesses are a few missing natural synonyms (LLM judge, evals) and no scoping cue distinguishing it from the upstream OSS mlflow evaluation skill it layers on top of.

DimensionReasoningScore

Specificity

The description lists multiple concrete capabilities with exact API names: "writing mlflow.genai.evaluate() code, creating @scorer functions, using built-in scorers (Guidelines, Correctness, Safety, RetrievalGroundedness), building eval datasets from traces, setting up trace ingestion and production monitoring, aligning judges with MemAlign... or running optimize_prompts() with GEPA" — this matches the comprehensive anchor and mirrors the body's actual scope (trace ingestion, judge alignment, prompt optimization, datasets, scorers). Not a 4 because coverage has no minor gaps: every major workflow in the body has a corresponding trigger.

5 / 5

Completeness

Explicitly answers both: the first sentence is a clear "what" (MLflow 3 GenAI agent evaluation plus an enumerated capability list) and "Use when writing mlflow.genai.evaluate() code, creating @scorer functions..." is an explicit trigger clause with concrete conditions. This matches the anchor-5 example structure exactly; a 4 would require the 'when' to be less explicit, which it is not.

5 / 5

Trigger Term Quality

Good natural-term coverage: "agent evaluation", "eval datasets from traces", "production monitoring", "prompt improvement" — phrases a user working in this domain would naturally say — plus the API names a practitioner would literally type. Not a 5 because some common synonyms are missing (e.g., "LLM judge"/"LLM-as-judge", "evals", "scoring") which are frequent ways users phrase this need.

4 / 5

Distinctiveness Conflict Risk

Clear niche with distinct triggers (mlflow.genai.evaluate(), @scorer, MemAlign, GEPA) that no other Databricks skill would claim, so conflict risk with sibling skills is minimal. Not a 5 because the description does not scope itself to Databricks or distinguish itself from the OSS mlflow/skills agent-evaluation skill (which the body explicitly defers to), so generic MLflow evaluation requests could route here when the upstream skill is canonical.

4 / 5

Total

18

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 4 suspicious

Warning

Total

14

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

plugins/databricks/claude/skills/databricks-mlflow-evaluation/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.