CtrlK
BlogDocsLog inGet started
Tessl Logo

pagerduty-automation

Automate PagerDuty tasks via Rube MCP (Composio): manage incidents, services, schedules, escalation policies, and on-call rotations. Always search tools first for current schemas.

48

Quality

51%

Does it follow best practices?

Impact

No eval scenarios have been run

SecuritybySnyk

Advisory

Suggest reviewing before use

Optimize this skill with Tessl

npx tessl skill review --optimize ./plugins/all-skills/skills/pagerduty-automation/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

35%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This skill is comprehensive in coverage of PagerDuty operations but suffers from significant verbosity and repetition, making it token-inefficient. It provides good structural organization with clear workflow sequences but lacks executable examples, validation steps, and proper progressive disclosure. The content would benefit greatly from being condensed into a lean overview with detailed sections split into separate files.

Suggestions

Reduce the content by 50%+ by removing duplicated information (e.g., status transitions mentioned in multiple places, Quick Reference table that repeats all workflow tools) and trusting that RUBE_SEARCH_TOOLS provides parameter schemas dynamically.

Add at least one concrete, executable MCP tool call example with actual JSON payload (e.g., a complete PAGERDUTY_CREATE_INCIDENT_RECORD call with service object) rather than just listing parameter names.

Add validation checkpoints to workflows, e.g., 'After creating an incident, verify the response contains an incident ID and status is triggered' or 'If creation fails with 400, check that the service ID exists by calling PAGERDUTY_RETRIEVE_SERVICE_BY_ID'.

Split detailed per-workflow parameters and pitfalls into a separate reference file, keeping SKILL.md as a concise overview with the setup, common patterns, and links to detailed workflow docs.

DimensionReasoningScore

Conciseness

The skill is extremely verbose at ~250+ lines, with significant repetition across sections. The 'Pitfalls' sections repeat information (e.g., status transitions mentioned in both Incidents and Known Pitfalls), the Quick Reference table duplicates all the tool names already listed in the workflows, and many parameters/details could be discovered via the RUBE_SEARCH_TOOLS call that the skill itself mandates. Much of this is API reference material Claude could retrieve dynamically.

1 / 3

Actionability

The skill provides tool names, parameter names, and sequences, but no executable code or concrete MCP call examples with actual payloads. The 'Common Patterns' section uses pseudocode-style numbered lists rather than showing actual tool invocations with example parameters. Key details like exact JSON structures for service objects or escalation rules are described but not shown.

2 / 3

Workflow Clarity

Workflows are clearly sequenced with numbered steps and labeled as Required/Optional, which is helpful. However, there are no validation checkpoints or feedback loops — no guidance on verifying that an incident was actually created, checking for error responses, or handling failures. For operations like creating services or escalation policies (which have dependencies), missing validation caps this at 2.

2 / 3

Progressive Disclosure

The content is a monolithic file with no bundle files to reference. All six workflow sections, common patterns, known pitfalls, and the quick reference table are inline. The detailed per-workflow parameter lists and pitfalls could be split into separate reference files, with the main SKILL.md serving as a concise overview. The single external link to Composio docs is appropriate but insufficient for the volume of content.

2 / 3

Total

7

/

12

Passed

Description

67%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is strong in specificity and distinctiveness, clearly identifying PagerDuty as the domain and listing concrete resource types it manages. Its main weakness is the absence of an explicit 'Use when...' clause, which would help Claude know exactly when to select this skill. Adding natural trigger phrases users might say would also improve discoverability.

Suggestions

Add an explicit 'Use when...' clause, e.g., 'Use when the user asks about PagerDuty incidents, on-call schedules, escalation policies, or service management.'

Include natural user-facing trigger variations such as 'who is on call', 'page someone', 'incident response', 'alerts', or 'duty schedule' to improve matching against how users actually phrase requests.

DimensionReasoningScore

Specificity

Lists multiple specific concrete actions: manage incidents, services, schedules, escalation policies, and on-call rotations. Also specifies the mechanism (Rube MCP via Composio) and includes a behavioral instruction to search tools first.

3 / 3

Completeness

Clearly answers 'what does this do' (automate PagerDuty tasks including incidents, services, schedules, etc.), but lacks an explicit 'Use when...' clause. The 'when' is only implied by the domain terms. Per rubric guidelines, a missing 'Use when...' clause caps completeness at 2.

2 / 3

Trigger Term Quality

Includes good domain-specific terms like 'PagerDuty', 'incidents', 'services', 'schedules', 'escalation policies', 'on-call rotations'. However, it lacks common user-facing variations like 'paging', 'alerts', 'who is on call', 'incident response', or 'duty schedule' that users might naturally say.

2 / 3

Distinctiveness Conflict Risk

Very clearly scoped to PagerDuty specifically, with the additional qualifier of using Rube MCP (Composio). This is a distinct niche that is unlikely to conflict with other skills unless there's another PagerDuty skill.

3 / 3

Total

10

/

12

Passed

Validation

90%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation10 / 11 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

10

/

11

Passed

Repository
davepoon/buildwithclaude
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.