CtrlK
BlogDocsLog inGet started
Tessl Logo

pagerduty-automation

Automate PagerDuty tasks via Rube MCP (Composio): manage incidents, services, schedules, escalation policies, and on-call rotations. Always search tools first for current schemas.

49

Quality

54%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./plugins/AI-Agents-Safe-Coding-Skills/skills/pagerduty-automation/SKILL.md

The canonical home for this skill is pagerduty-automation in administrakt0r/AI-Agents-Safe-Coding-Skills

SKILL.md
Quality
Evals
Security

Quality

Content

38%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This skill provides a comprehensive catalog of PagerDuty operations via Rube MCP with clear tool names and parameter documentation, but suffers from significant verbosity and repetition. The lack of executable examples (no actual tool call syntax with sample values), missing validation/verification steps in workflows, and monolithic structure weaken its effectiveness. It reads more like API documentation than an actionable skill guide.

Suggestions

Add concrete, executable tool call examples with sample parameter values for at least the most common operations (e.g., creating an incident, listing on-call users) rather than just listing parameter names.

Add validation/verification steps after mutation operations (e.g., after creating an incident, verify it appears in the incident list; after updating a service, confirm the new status).

Reduce repetition by consolidating the Known Pitfalls section with the per-workflow Pitfalls — choose one location for each piece of information rather than stating it twice.

Split the content into separate files for each major workflow area (incidents, services, schedules, escalation policies) and use SKILL.md as a concise overview with references.

DimensionReasoningScore

Conciseness

The skill is significantly verbose with substantial repetition. Key parameters and pitfalls are repeated across sections (e.g., service references needing 'type' is mentioned in both Incidents and Known Pitfalls). The 'When to use' labels, [Required]/[Optional] annotations on every tool, and the massive quick reference table that duplicates information already covered in each workflow section all add unnecessary bulk. Claude doesn't need explanations of what incident lifecycle means or what pagination is.

2 / 5

Actionability

The skill provides tool names, parameter names, and sequences, which is useful. However, there are no executable code examples — the 'ID Resolution' and 'Incident Lifecycle' sections use pseudocode-style numbered lists rather than actual tool call examples with concrete parameter values. The instruction to 'always call RUBE_SEARCH_TOOLS first' partially compensates since schemas are dynamic, but concrete example tool calls with sample parameters would significantly improve actionability.

3 / 5

Workflow Clarity

Workflows are sequenced with numbered steps and labeled as Required/Optional, which provides structure. However, there are no validation checkpoints or feedback loops. For operations like creating incidents, services, or updating escalation policies, there's no 'verify the result' step. The setup section has a good validation flow (check connection -> authenticate -> confirm ACTIVE), but the core workflows lack error handling or verification steps after mutations.

3 / 5

Progressive Disclosure

Everything is in a single monolithic file with no bundle files or references to external documentation. At ~200+ lines covering 6 distinct workflow areas plus common patterns, known pitfalls, and a quick reference table, this content would benefit significantly from splitting into separate files (e.g., incidents.md, services.md, schedules.md). The quick reference table partially helps navigation but doesn't compensate for the wall of content.

2 / 5

Total

10

/

20

Passed

Description

70%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description effectively identifies the domain (PagerDuty) and lists several concrete resource types it can manage, making it reasonably specific and highly distinctive. However, it lacks an explicit 'Use when...' clause that would help Claude know when to select this skill, and the verb 'manage' could be broken down into more specific actions. The mention of 'Always search tools first for current schemas' is an implementation instruction rather than a description aid.

Suggestions

Add an explicit 'Use when...' clause, e.g., 'Use when the user asks about PagerDuty incidents, on-call schedules, escalation policies, or needs to page someone.'

Replace the generic 'manage' with specific actions like 'create, update, acknowledge, and resolve incidents; configure services and schedules; query on-call rotations'.

Move the implementation instruction ('Always search tools first for current schemas') out of the description, as it doesn't help with skill selection and takes up space that could be used for trigger terms.

DimensionReasoningScore

Specificity

Lists several specific actions: manage incidents, services, schedules, escalation policies, and on-call rotations. These are concrete PagerDuty concepts, though 'manage' is somewhat generic and doesn't specify sub-actions like create, update, delete, or acknowledge.

4 / 5

Completeness

Has a clear 'what' (automate PagerDuty tasks including incidents, services, schedules, etc.) but lacks an explicit 'when' clause. There is no 'Use when...' guidance specifying trigger conditions for Claude to select this skill.

3 / 5

Trigger Term Quality

Includes strong natural keywords like 'PagerDuty', 'incidents', 'services', 'schedules', 'escalation policies', 'on-call rotations'. Missing some natural user phrases like 'who is on call', 'page someone', 'acknowledge alert', or 'trigger incident'.

4 / 5

Distinctiveness Conflict Risk

Highly distinctive with clear niche: PagerDuty automation via Rube MCP (Composio). The combination of PagerDuty-specific terminology and the specific tooling (Rube MCP/Composio) makes it very unlikely to conflict with other skills.

5 / 5

Total

16

/

20

Passed

Validation

90%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation10 / 11 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

10

/

11

Passed

Repository
administrakt0r/AI-Agents-Safe-Coding-Skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.