CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

railway-observability

Railway.com built-in metrics, monitoring dashboards, alerting (Pro plan), and external OTEL integration with Grafana. Use when setting up monitoring, creating dashboards, configuring alerts, integrating Prometheus/Loki/Tempo, deploying Grafana stack, or analyzing Railway service metrics.

Quality

75%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/railway-observability/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

56%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is genuinely actionable with concrete commands, configs, and verification steps, but it is badly bloated: Quick Start and Workflow duplicate each other, key facts are repeated many times, and material that belongs in references/ is inlined. The bundle also has a dangling reference to a nonexistent templates/alloy-config.river, which both hurts navigation and undermines the executable guidance.

Suggestions

Merge the Quick Start and Workflow sections into one canonical five-step procedure; the current duplication roughly halves the effective token budget of the file.

Create templates/alloy-config.river (or remove the reference) and add an inline citation of references/metrics-reference.md at the point where metrics are discussed.

Move the full Alloy river config, the Node.js/Python integration examples, and the alert-threshold tables into references/ files, keeping only pointers and one minimal example in SKILL.md.

DimensionReasoningScore

Conciseness

The ~650-line body duplicates whole sections: "Quick Start" and "Workflow" cover the same five steps nearly verbatim, the 30-day retention and Template ID 8TLSQD are repeated 5-6 times, OTEL env vars appear twice, and time-range options and notification channels are listed three times each. Not a 1 because there is no explanation of concepts Claude already knows — the padding is redundancy, not over-explanation.

2 / 5

Actionability

Mostly executable guidance: concrete OTEL env-var blocks, CLI commands, a full Alloy river config, webhook JSON payloads, and Node/Python instrumentation examples. Not a 5 because the Python example uses PeriodicExportingMetricReader without importing it, Step 4's "Configure Alloy collector" is comment-only pseudocode, and the body directs readers to a script path and a templates/alloy-config.river file that does not exist in the bundle.

4 / 5

Workflow Clarity

The five-step Workflow has a clear sequence, a verification checkpoint ("Verify integration: railway logs -s alloy" with expected output), and a troubleshooting section with debug checklists for alerts and OTEL. Not a 5 because the duplicate Quick Start/Workflow sections blur the canonical path and there is no post-deployment validation for the Grafana stack.

4 / 5

Progressive Disclosure

References/ files exist and are clearly signaled inline ("See references/otel-integration.md for complete setup"), but the body references "templates/alloy-config.river" in three places and lists a templates/ directory in its Architecture section that does not exist in the bundle — a dangling path Claude would hit. Additionally, the full Alloy config, integration examples, and alert threshold tables are inlined rather than split into references, and references/metrics-reference.md is listed in the Architecture map but never cited at point of need.

3 / 5

Total

13

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete capability list, explicit 'Use when' triggers, and a clearly differentiated Railway.com niche. Its only weaknesses are noun-phrase rather than action-verb phrasing and a few missing natural trigger terms (observability, tracing, troubleshooting).

DimensionReasoningScore

Specificity

Lists several specific capabilities — "built-in metrics, monitoring dashboards, alerting (Pro plan), and external OTEL integration with Grafana" — naming the domain and concrete feature areas. Not a 5 because capabilities are stated as noun phrases rather than actions, and tracing/troubleshooting coverage from the body is only implied via Tempo.

4 / 5

Completeness

Explicitly answers both what ("built-in metrics, monitoring dashboards, alerting (Pro plan), and external OTEL integration with Grafana") and when ("Use when setting up monitoring, creating dashboards, configuring alerts...") with concrete trigger phrases, matching the top anchor.

5 / 5

Trigger Term Quality

Natural phrases users would say: "setting up monitoring, creating dashboards, configuring alerts, integrating Prometheus/Loki/Tempo, deploying Grafana stack, or analyzing Railway service metrics". Not a 5 because common variations like "observability", "tracing", and "troubleshooting resource issues" (all in the body) are missing from the trigger clause.

4 / 5

Distinctiveness Conflict Risk

Railway.com is a clear niche and most triggers are scoped to it, but generic phrases like "deploying Grafana stack" and "integrating Prometheus/Loki/Tempo" could overlap with a general observability or Grafana skill. Minor overlap risk, so above the midpoint rather than the top anchor.

4 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (658 lines); consider splitting into references/ and linking

Warning

Total

15

/

16

Passed

Repository

fernandezbaptiste/Skrillz

Path

skills/railway-observability/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.