CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

validate-templates

Deploy-validate and functionally exercise the app templates against a shared Databricks App. Use when: (1) reviewing a PR that changes templates, (2) checking which templates deploy and serve, (3) running the e2e/deploy-validation or functional-e2e suites, (4) regenerating the validation report. Repo-dev tool — NOT synced into templates.

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

96%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary operational skill body: lean, assumes competence, gives copy-paste commands for every common case, and pairs them with explicit failure signatures and recovery actions. The only structural nit is that the dense verify-mode/OBO reference detail is inlined rather than split into a bundled reference file.

DimensionReasoningScore

Conciseness

The body is dense operational knowledge with zero padding — no concept explanations Claude already has; instead it encodes non-obvious gotchas ("never pipe pytest through head/tail — SIGPIPE kills cleanup", "SSO storageState... expires ~daily", OBO scopes "must be CREATED... not patched later"). Every token carries repo-specific information; not score 4 because there is no over-explanation to trim, only inherent complexity.

5 / 5

Actionability

Fully executable guidance: complete pytest invocations with env vars and flags (DATABRICKS_CONFIG_PROFILE=dogfood uv run --no-sync pytest validate_templates.py -p no:xdist -v), the auth_setup.py command with a URL template, repeatable --val-template usage, and a concrete config snippet (`<name>: { verify: html, expect: "Todo List App" }`). The `...` shorthand only abbreviates an already-shown full command, so everything is copy-paste ready.

5 / 5

Workflow Clarity

Clear sequence (Prerequisites → Running → Interpreting results → Adding/fixing coverage) with explicit feedback loops: SSO failure ("app redirected to SSO login — storageState invalid/expired") → re-run auth_setup.py; 502 after ~240s → check build/runtime logs in the Apps UI; a checklist of expected non-pass buckets that are not template bugs. Not score 4 because validation checkpoints and error-recovery paths are explicit rather than minor-gap.

5 / 5

Progressive Disclosure

Well-organized sections with one clearly signaled, one-level-deep pointer ("See .scripts/agent-integration-tests/AGENTS.md for module-level detail") and appropriate pointers to validation-config.yaml / functional_config.py for edits. Not score 5 because the long inline verify-mode semantics and OBO creation detail are borderline reference material that could live in a separate file, keeping SKILL.md a leaner overview.

4 / 5

Total

19

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, concrete, with an explicit four-item 'Use when' trigger list and a clear scope boundary. Its only weaknesses are trigger keyword coverage that omits some synonyms and script/file names, and a what-clause that front-loads only two verbs.

Suggestions

Add natural synonyms and concrete artifact names to the trigger list (e.g. validate_templates.py, validation-report.md, 'smoke test', 'template CI') so users searching by file or report name still match.

State the outputs in the what-clause (writes logs/validation-report.md and logs/functional-report.md) so the capability list is complete without reading the trigger list.

DimensionReasoningScore

Specificity

"Deploy-validate and functionally exercise the app templates against a shared Databricks App" plus "regenerating the validation report" and "checking which templates deploy and serve" names several concrete actions in a specific domain, but the what-clause itself is condensed to two verbs with the rest of the action detail carried by the use-when list. Not score 5 because coverage of actions is split across the trigger list rather than comprehensively stated as capabilities; not 3 because far more than 1-2 concrete actions are named.

4 / 5

Completeness

Both what ("Deploy-validate and functionally exercise the app templates against a shared Databricks App") and when ("Use when: (1) reviewing a PR that changes templates, (2)... (3)... (4)...") are explicitly and concretely answered with a structured trigger list. Clearly matches the score-5 anchor; score 4 would under-credit the four explicit, concrete trigger phrases.

5 / 5

Trigger Term Quality

Natural phrases users would say are present — "reviewing a PR that changes templates", "checking which templates deploy and serve", "running the e2e/deploy-validation or functional-e2e suites", "regenerating the validation report". Missing some synonyms and concrete file/script names (e.g. validate_templates.py, validation-report.md, 'smoke test'), so it does not reach the comprehensive synonym/extension coverage of score 5.

4 / 5

Distinctiveness Conflict Risk

The niche (Databricks Apps template deploy/functional validation) is distinct and even carries a boundary statement ("Repo-dev tool — NOT synced into templates"), minimizing misuse. Minor overlap risk remains with generic test-running or PR-review phrasing (e.g. a user asking to 'run the e2e tests' or 'review this PR' in a broader context), so it sits just below score 5.

4 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

databricks/app-templates

Path

.claude/skills/validate-templates/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.