CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-mlflow-evaluation

MLflow GenAI evaluation and agent improvement on Databricks. Use when running mlflow.genai.evaluate(), building scorers or datasets, aligning judges with MemAlign, optimizing prompts, or monitoring production quality.

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary hub-style SKILL.md: extremely token-efficient, routes requests to verified guides via a clear table, and inlines only high-value cross-cutting knowledge (model URI/version requirements, 404/403 diagnostics, baseline methodology). The only ceiling is that executable detail lives in the referenced guides, which is the intended design rather than a defect.

DimensionReasoningScore

Conciseness

The 28-line body is lean and assumes competence with zero padding: every sentence carries skill-specific knowledge ('A 404 commonly indicates an older client', 'prefer databricks:/system.ai.<model> with a mlflow[databricks]>=3.16.0', 'establish a baseline with a fixed dataset and scorers, change one thing'). Matches anchor 5; the version pins are functional requirements, not the date-branched deprecation guidance the rubric penalizes.

5 / 5

Actionability

Provides concrete, executable specifics: exact model URI pattern, version requirement, error-code-to-cause diagnostics (404 -> old client, 403 -> legacy endpoints disabled), and a concrete baseline -> change one thing -> rerun procedure. Not 5 because nothing is copy-paste ready and most executable detail is delegated to the referenced guides; well above 3 since the inline guidance is specific and directive rather than vague.

4 / 5

Workflow Clarity

A clear sequence is present: read databricks-core for auth, route via the request table, 'Verify tracing when the selected evaluation mode or scorers require it', baseline -> change one thing -> rerun the same evaluation, with an explicit validation checkpoint ('Verify the installed client and available system.ai model before changing credentials or permissions') and error-recovery guidance for 404/403. Not 5 because the full per-task step sequences and checkpoints live in the referenced guides rather than in this overview, leaving minor validation gaps at this level.

4 / 5

Progressive Disclosure

Scored against the actual bundle: all three paths referenced from SKILL.md (references/mlflow-evaluation/references/scorer-design.md, references/mlflow-evaluation/guide.md, references/mlflow-agent-improvement/guide.md) exist, and the guides link onward to real topic files (scorers.md, dataset-preparation.md, throughput-guide.md, regression-test-suite.md, etc.) with explicit 'read X when...' signals. The body is a pure, well-organized router with a request-to-guide table; content is appropriately split and navigation is easy. Not 4 because there are no organization gaps: every reference is clearly signaled and verified present.

5 / 5

Total

18

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, concise, with an explicit 'Use when' clause enumerating concrete, natural triggers. The 'what' half is slightly terser than the top anchor and a couple of broad phrases (prompt optimization, production monitoring) leave minor overlap risk with neighboring skills.

DimensionReasoningScore

Specificity

Names the domain ('MLflow GenAI evaluation and agent improvement on Databricks') and lists several concrete actions ('running mlflow.genai.evaluate()', 'building scorers or datasets', 'aligning judges with MemAlign', 'optimizing prompts', 'monitoring production quality'). Not 5 because the 'what' clause relies on fairly generic nouns (evaluation, improvement) rather than the comprehensive concrete action list of the top anchor; clearly above 3 with multiple specific actions.

4 / 5

Completeness

Explicitly answers both halves: what ('MLflow GenAI evaluation and agent improvement on Databricks') and when ('Use when running mlflow.genai.evaluate(), building scorers or datasets, aligning judges with MemAlign, optimizing prompts, or monitoring production quality') with concrete trigger phrases. Direct match to the anchor-5 example pattern; not 4 because the 'when' is already explicit and specific.

5 / 5

Trigger Term Quality

Good natural keyword coverage for the domain: 'mlflow.genai.evaluate()', 'scorers', 'datasets', 'judges', 'optimizing prompts', 'monitoring production quality' are phrases users would naturally say. Not 5 because common variations and synonyms (e.g., 'evaluate my agent', 'LLM eval', 'quality metrics', 'regression') are absent; well above 3's partial coverage.

4 / 5

Distinctiveness Conflict Risk

Clear niche with distinct, tool-specific triggers (mlflow.genai.evaluate, MemAlign, scorers) that are unlikely to fire for unrelated skills. Not 5 because 'optimizing prompts' and 'monitoring production quality' are general activities with minor overlap risk against adjacent skills; not 3 because the MLflow/Databricks framing keeps it mostly distinct.

4 / 5

Total

17

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 3 deeper-than-1-level

Warning

referenced_paths_exist

Referenced path issues: 3 deeper-than-1-level

Warning

Total

13

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

plugins/databricks/claude/skills/databricks-mlflow-evaluation/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.