CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

railway-observability

Railway.com built-in metrics, monitoring dashboards, alerting (Pro plan), and external OTEL integration with Grafana. Use when setting up monitoring, creating dashboards, configuring alerts, integrating Prometheus/Loki/Tempo, deploying Grafana stack, or analyzing Railway service metrics.

Quality

74%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./.claude/skills/railway-observability/SKILL.md

The canonical home for this skill is railway-observability in fernandezbaptiste/Skrillz

SKILL.md
Quality
Evals
Security

Quality

Content

50%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is rich in concrete, platform-specific detail and mostly executable examples, but it is heavily padded: the same content is repeated across three sections, workflows lack inline validation checkpoints, and detail that belongs in the existing reference files (plus a dangling templates/ path) is inlined. It reads as a reference document compressed into SKILL.md rather than a lean overview with progressive disclosure.

Suggestions

Collapse the triplicated coverage: keep one workflow (either Quick Start or Workflow Steps 1-5) and delete the repeated "Key Features"/"Notes" restatements of retention, Pro-plan, and template-ID facts.

Move the inline Alloy river config, Node/Python integration examples, and Grafana stack details into references/ files (e.g., otel-integration.md, a new grafana-stack.md), keeping SKILL.md a concise overview that links to them.

Add inline validation checkpoints to each workflow step — e.g., verify all five stack services are up and Grafana is reachable after deploy, and send a test alert to the webhook after configuring a rule.

Fix the dangling reference: create templates/alloy-config.river or repoint the multiple mentions to an existing file path.

DimensionReasoningScore

Conciseness

The same five topics (metrics, dashboards, alerts, OTEL, Grafana stack) are each covered three full times across "Quick Start", "Workflow", and "Key Features"; facts like "30 days" retention, "Pro plan" requirement, and template ID "8TLSQD" are each restated about five times, plus a padded "Keywords" line. This is noticeably verbose with several duplicated/padded sections rather than occasional looseness, so it sits at 2 rather than 3.

2 / 5

Actionability

Provides concrete navigation paths, executable OTEL env-var blocks, a full Alloy river config, runnable Node and Python examples, CLI commands, and webhook JSON payloads. Not 5: the Python example omits the PeriodicExportingMetricReader import and the alert "YAML" block is descriptive rather than executable.

4 / 5

Workflow Clarity

Steps are clearly numbered and sequenced, but two parallel 5-step sequences (Quick Start and Workflow) cover identical ground, and validation is mostly absent from the steps themselves — only Step 4 has an inline checkpoint ("Verify integration" / check Alloy logs); the 5-service stack deploy has no verification and alert setup has no test step in the workflow. Checkpoints are missing or implicit, matching 3 rather than 4.

3 / 5

Progressive Disclosure

References are real files, clearly signaled ("See references/otel-integration.md for complete setup"), and one level deep; scripts/deploy-grafana-stack.sh exists. However, "templates/alloy-config.river" is referenced repeatedly but no templates/ directory exists, and substantial reference-grade material (the Alloy config, integration examples, full Grafana stack details) is inlined in a ~650-line body, so content that should be separate remains inline — matching 3 rather than 4.

3 / 5

Total

12

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with a clear capability list and an explicit, concrete "Use when..." trigger clause. It is specific to the Railway.com observability niche with natural trigger phrases; the only weaknesses are a few missing synonyms and minor overlap risk with generic Grafana/observability skills.

DimensionReasoningScore

Specificity

Lists multiple concrete capabilities ("built-in metrics, monitoring dashboards, alerting (Pro plan), and external OTEL integration with Grafana") and concrete actions ("setting up monitoring, creating dashboards, configuring alerts, ... deploying Grafana stack, or analyzing Railway service metrics") with comprehensive coverage of the skill's domain. Not 4 because coverage has no material gaps.

5 / 5

Completeness

Explicitly answers both "what" (built-in metrics, dashboards, alerting, OTEL integration) and "when" via a concrete "Use when setting up monitoring, creating dashboards, configuring alerts..." clause. Matches the 5 anchor directly.

5 / 5

Trigger Term Quality

Includes natural phrases users would say ("setting up monitoring", "creating dashboards", "configuring alerts", "deploying Grafana stack") plus platform terms (Railway.com, Grafana, Prometheus/Loki/Tempo). Not 5 because synonyms like "observability", "logs", and "tracing" are missing from the description.

4 / 5

Distinctiveness Conflict Risk

Anchored to Railway.com, giving a clear niche, but the "deploying Grafana stack" and Prometheus/Loki/Tempo triggers could overlap with a generic Grafana/observability skill (the body cross-references a sibling observability-stack-setup skill). Mostly distinct with minor overlap risk against closely related skills.

4 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (658 lines); consider splitting into references/ and linking

Warning

Total

15

/

16

Passed

Repository

fernandezbaptiste/Skrillz

Path

.claude/skills/railway-observability/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.