CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

diagnostics

Diagnose a crashed, hung, or erroring deployed Databricks App. Use when: (1) an app is crashed / UNAVAILABLE / 502s, (2) an app hangs or is unresponsive, (3) you need the stack trace behind a failure, (4) questions about reading app logs or the diagnostics env toggles.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is diagnostics in databricks/app-templates

SKILL.md
Quality
Evals
Security

Quality

Content

93%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary diagnostic skill body: dense with platform-specific facts Claude cannot know, copy-paste-ready commands and exact log signatures, and clean section structure. The only gap is the absence of an explicit recovery/verification loop for the failure paths of the diagnostic procedure itself (empty log viewer, watchdog toggle not taking effect).

DimensionReasoningScore

Conciseness

Every token carries non-obvious, platform-specific information (SSO websocket 302 blocking the CLI, SIGTERM all-thread dumps, pods lacking CAP_SYS_PTRACE) with no padding and no explanation of concepts Claude already knows. Even the 'Why not pyspy/gdb/strace' note conveys real constraints rather than filler.

5 / 5

Actionability

Fully executable throughout: the log-viewer URL pattern, 'databricks apps logs <app-name> --follow --profile <profile>', 'databricks apps get ... | jq '.app_status'', a concrete app.yaml env snippet, 'kill -USR1 <pid>', and exact log signatures to match — covering the common Python, Node, crash, and hang cases.

5 / 5

Workflow Clarity

The diagnostic sequence is clear (read logs → match signatures → hang-specific escalation) with a built-in checkpoint ('app.diagnostics: installed (pid=…)' confirms the bootstrap ran) and explicit SSO/non-SSO branching. It falls short of anchor 5 only because there is no explicit error-recovery loop, e.g. what to do when the log viewer shows nothing or how to confirm the watchdog toggle took effect after redeploy.

4 / 5

Progressive Disclosure

Well-organized sections with no content that belongs in a separate file at this size, and the single external pointer (crash fixtures at '.scripts/agent-integration-tests/crash-examples/') is clearly signaled and exactly one level deep. Navigation is easy and there are no nested references.

5 / 5

Total

19

/

20

Passed

Description

82%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A well-crafted description with an explicit, enumerated 'Use when:' clause and distinctive, natural trigger terms including status codes. Its main weakness is that the 'what' compresses everything into a single 'Diagnose' verb rather than enumerating the concrete diagnostic capabilities.

Suggestions

Expand the 'what' clause to enumerate the concrete actions the skill performs, e.g. "Diagnose a crashed, hung, or erroring deployed Databricks App: read crash and shutdown stack traces from app logs, interpret SIGTERM all-thread dumps, and configure diagnostics env toggles."

Add a few common failure-signal synonyms to the triggers, such as 500 errors, failing health checks, or restart loops, to broaden natural-term coverage.

DimensionReasoningScore

Specificity

The 'what' clause is a single concrete action — "Diagnose a crashed, hung, or erroring deployed Databricks App" — which names the domain plus one action but does not list several distinct capabilities; sub-actions like retrieving stack traces appear only as trigger conditions. This matches 'Names domain and 1-2 concrete actions' rather than the level above ('Lists several specific actions').

3 / 5

Completeness

Explicitly answers both questions: the 'what' ("Diagnose a crashed, hung, or erroring deployed Databricks App") and a numbered 'Use when:' clause with four concrete trigger conditions. This matches the anchor for clearly and explicitly answering both what and when with concrete trigger phrases.

5 / 5

Trigger Term Quality

Strong natural coverage: "crashed / UNAVAILABLE / 502s", "hangs or is unresponsive", "stack trace", "app logs", "diagnostics env toggles" — terms a user would actually say, including status codes. A few common variations (e.g., 500s, failing health checks, restart loop) are missing, keeping it below comprehensive anchor 5.

4 / 5

Distinctiveness Conflict Risk

"deployed Databricks App" carves out a clear niche with platform-specific triggers (UNAVAILABLE, 502s, diagnostics env toggles) that are unlikely to fire for the wrong skill. Overlap with generic debugging or logging skills is minimal.

5 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

databricks/app-templates

Path

agent-langgraph-advanced/.claude/skills/diagnostics/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.