CtrlK
BlogDocsLog inGet started
Tessl Logo

coderabbit-observability

Monitor CodeRabbit review effectiveness with metrics, dashboards, and alerts. Use when tracking review coverage, measuring comment acceptance rates, or building dashboards for CodeRabbit adoption across your organization. Trigger with phrases like "coderabbit monitoring", "coderabbit metrics", "coderabbit observability", "monitor coderabbit", "coderabbit alerts", "coderabbit dashboard".

71

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-3

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable with complete, executable scripts and workflows, clear sequencing, and useful error handling. It loses points for some explanatory padding and for a monolithic structure with a dangling reference to a missing runbook file.

Suggestions

Tighten prose padding — drop or trim the 'Why It Matters' column and the Step 2 'Healthy ranges' narrative so Claude isn't re-told what it can infer about metric tradeoffs.

Either create the referenced `coderabbit-incident-runbook` bundle file or remove the dangling 'Next Steps' reference so navigation isn't broken.

For a 260-line skill, consider moving the full GitHub Actions workflow YAMLs (Steps 3–4) into a `references/` file and keeping only a short summary plus a one-level-deep link in SKILL.md, improving progressive disclosure.

DimensionReasoningScore

Conciseness

The body is mostly executable code and concrete tables (token-efficient), but the 'Why It Matters' column, the Step 2 'Healthy ranges' narrative, and the dashboard 'Action Items' interpretations add explanatory padding Claude could infer — matching score-2 (mostly efficient, some tightening possible) rather than score-3 (every token earns its place).

2 / 3

Actionability

Steps 1–4 supply complete, copy-paste-ready bash scripts and GitHub Actions YAML workflows with real gh/github-script calls, matching the score-3 anchor of fully executable, specific examples.

3 / 3

Workflow Clarity

Five steps are clearly numbered and sequenced with guard conditions (e.g. `if [ "$TOTAL" -gt 0 ]` div-by-zero checks) and a dedicated Error Handling table mapping issues to fixes; the batch operations are read-only so the destructive-operations cap does not apply.

3 / 3

Progressive Disclosure

Content is well-organized into sections but monolithic (~260 lines all inline in SKILL.md) with no bundle files, and the lone 'Next Steps' reference to `coderabbit-incident-runbook` points to a file that does not exist — a dangling reference — matching score-2 rather than the score-3 one-level-deep, well-signaled reference pattern.

2 / 3

Total

10

/

12

Passed

Description

100%Weight 40%Scale 1-3

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is third-person, specific, and complete: it states concrete capabilities, gives an explicit 'Use when' clause, and lists natural trigger phrases. It avoids vague fluff and is clearly distinguishable from other skills.

DimensionReasoningScore

Specificity

Names multiple concrete actions — "Monitor CodeRabbit review effectiveness with metrics, dashboards, and alerts", "tracking review coverage", "measuring comment acceptance rates", "building dashboards" — matching the score-3 anchor of listing several specific actions.

3 / 3

Completeness

Clearly answers both what ("Monitor CodeRabbit review effectiveness with metrics, dashboards, and alerts") and when ("Use when tracking review coverage... or building dashboards") with an explicit trigger list, matching the score-3 what-and-when anchor.

3 / 3

Trigger Term Quality

Provides an explicit, natural set of trigger phrases ("coderabbit monitoring", "coderabbit metrics", "coderabbit observability", "monitor coderabbit", "coderabbit alerts", "coderabbit dashboard") that a user would plausibly say, giving good coverage rather than jargon.

3 / 3

Distinctiveness Conflict Risk

Targets a clear niche (CodeRabbit observability) with CodeRabbit-specific triggers unlikely to fire for unrelated skills; not generic enough to conflict broadly.

3 / 3

Total

12

/

12

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

14

/

16

Passed

Repository
jeremylongshore/claude-code-plugins-plus-skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.