CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

lightrun-error-remediation-automation

Guide deterministic runtime investigations in environments using Lightrun MCP tools, with preflight gating, recovery/resume rules, evidence-first diagnosis, PR-first fix proposal delivery, and local source-code fallback only when PR creation is not possible.

1.00x
Quality

71%

Does it follow best practices?

Impact

28%

1.00x

1 of 3 eval scenarios. Add 2 more for a full score.

SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./skills/lightrun-error-remediation-automation/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

66%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is an exceptionally well-gated workflow: explicit preflight/result gates, error-recovery feedback loops, machine-readable blockers, and a quality checklist give it top marks for workflow clarity and strong actionability. Its main liability is redundancy — the Quick Use Guide, Flow, principles, and checklist restate the same rules three to four times, inflating the token cost of a context-loaded skill.

Suggestions

Merge the "Quick Use Guide" and "Flow" sections into one sequence — they cover the same 10 steps with near-identical text, and the duplicate costs a large share of the skill's token budget.

State each gating rule once in its canonical section (e.g., the Mandatory Runtime Action Result Gate) and have other sections, including the checklist, reference it instead of restating it verbatim.

Move the detailed state-persistence storage-discovery protocol and the Output Contract field lists into files under references/ so SKILL.md reads as a lean overview with well-signaled one-level-deep pointers.

DimensionReasoningScore

Conciseness

There is no conceptual padding (the body never explains what Lightrun or MCP is), but the rules are duplicated wholesale: the "Quick Use Guide" (steps 1–10) restates the "Flow" section nearly verbatim, and the same gating rule ("do not open a PR, implement a local fix, cancel the action... until its required results have been retrieved") appears repeatedly across Investigation Principles, the Mandatory Runtime Action Result Gate, Runtime Action Cleanup, and the checklist. This matches "noticeably verbose; several unnecessary... padded sections"; it is not a 3 because the duplication spans entire sections of a ~330-line file, and not a 1 because nothing explains concepts Claude already knows.

2 / 5

Actionability

For an instruction-only skill the guidance is highly concrete: machine-readable blocker codes ("state-storage-unavailable", "runtime-source-ambiguous", "reproduction-required"), a prioritized storage-discovery protocol, rules to record "the selected tool identifier exactly as exposed by MCP", a troubleshooting URL, an investigation template, and a field-by-field output contract. It is not a 5 because there is no worked example of a persisted state record or a populated final handoff, and the tool-call guidance is necessarily abstract rather than copy-paste ready.

4 / 5

Workflow Clarity

The workflow has explicit validation checkpoints throughout: preflight pass/fail criteria gating all evidence tools ("Runtime evidence tools are activated only after preflight success"), a mandatory single-check result gate before any diagnosis or PR ("the investigation MUST verify whether the expected result is available before moving to diagnosis or fix delivery"), feedback loops for error recovery (Missing-MCP recovery, Action Error Mitigation with retry conditions), per-step Tools/Success definitions, and a final Runtime Quality Checklist. This matches the anchor "clear sequence with explicit validation steps; feedback loops for error recovery; checklists for complex processes".

5 / 5

Progressive Disclosure

The single reference file references/mcp-tool-discovery.md exists and contains every section and anchor cited in the body ("#source-discovery-preflight", "#missing-mcp-recovery", "#source-selection-guidance"), is one level deep, and is clearly signaled at each use. It is not a 5 because SKILL.md itself is a ~330-line monolith whose state-persistence protocol, cleanup rules, and output contract could reasonably live in reference files; it is not a 3 because the references that do exist are well-signaled, correctly linked, and verified real.

4 / 5

Total

15

/

20

Passed

Description

62%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description gives a concrete, well-scoped picture of what the skill does across its full workflow, anchored by the distinctive Lightrun MCP niche. Its main weakness is the complete absence of a "when to use" trigger clause and of the natural debugging vocabulary (debug, bug, error, incident) users would most likely say.

Suggestions

Append an explicit trigger clause, e.g. "Use when the user reports a runtime error, bug, or production incident in a service monitored by Lightrun, or asks to investigate/diagnose a failure at runtime."

Add natural user vocabulary such as "debug", "bug", "error", "incident", or "production issue" so the description matches how users actually phrase the need.

Replace the abstract opener "Guide deterministic runtime investigations" with a concrete verb phrase like "Investigate runtime errors and bugs in production services".

DimensionReasoningScore

Specificity

The description lists several concrete actions — "preflight gating", "recovery/resume rules", "evidence-first diagnosis", "PR-first fix proposal delivery", and "local source-code fallback only when PR creation is not possible" — with only minor gaps. It is not a 5 because the leading phrase "Guide deterministic runtime investigations" is abstract jargon rather than a concrete action, and not a 3 because five distinct workflow actions are explicitly named beyond just the domain.

4 / 5

Completeness

The "what" is clearly stated (guide runtime investigations with preflight gating, evidence-first diagnosis, PR-first fix delivery, local fallback), but there is no "Use when..." clause or any equivalent explicit trigger guidance for when to invoke the skill. Per the judging guidelines, a missing 'Use when...' clause caps completeness at 3; it is not a 2 because the "what" is concrete and multi-part.

3 / 5

Trigger Term Quality

Relevant keywords like "Lightrun MCP tools", "runtime investigations", "diagnosis", "fix proposal", and "PR" are present, but the natural phrases a user would actually say are missing: no "debug", "bug", "error", "incident", or "production issue" — notable given the skill is named error-remediation-automation. Fits the anchor "some relevant keywords but missing common variations"; it is not a 4 because the most likely user trigger phrasings for a debugging skill are absent.

3 / 5

Distinctiveness Conflict Risk

"Lightrun MCP tools" carves out a clear niche with distinct triggers, and the delivery-policy phrasing ("PR-first fix proposal delivery", "local source-code fallback") is specific to this skill, giving minimal conflict risk with generic debugging or code-review skills. Matches the anchor "clear niche with distinct triggers; minimal conflict risk".

5 / 5

Total

15

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

lightrun-platform/lightrun-ai

Path

skills/lightrun-error-remediation-automation/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.