Use this skill when the user asks to "set up monitoring", "configure observability", "onboard new service", "create saved view", "set up notifications", "configure webhook", "set up Slack integration", "outgoing webhook", "automation action", "webhook for alerts", "create view", "saved view", "view folder", "organize dashboards", "install integration", "configure extension", "contextual data", "connect external service", "create notification connector", "set up email alerts", "configure PagerDuty", "notification routing", "deploy extension", "test webhook", "notification preset", "test notification", "webhook actions", or wants to set up, configure, or manage the observability stack for a service or team.
65
57%
Does it follow best practices?
Impact
Pending
No eval scenarios have been run
Passed
No known issues
Optimize this skill with Tessl
npx tessl skill review --optimize ./skills/cx-observability-setup/SKILL.mdQuality
Discovery
64%Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.
The description is essentially a long list of trigger phrases with no clear statement of what the skill actually does. While the trigger term coverage is excellent and would help Claude match user requests, the lack of a capability summary (e.g., 'Configures monitoring dashboards, sets up alert notifications, and manages webhook integrations for observability platforms') makes it hard to understand the skill's scope. The description reads more like a keyword index than a skill description.
Suggestions
Add a clear capability summary at the beginning describing what the skill does (e.g., 'Configures monitoring, alerting, and observability infrastructure including dashboards, saved views, webhook integrations, and notification routing for services and teams.').
Reduce the trigger term list to the most distinctive and common phrases, and group related terms (e.g., 'Use when the user asks about monitoring setup, observability configuration, webhook/notification management, or integration with alerting tools like PagerDuty and Slack.').
Use third-person voice for the capability description (e.g., 'Sets up and configures observability stack components') — currently the description starts with 'Use this skill when' which is second-person instruction rather than a capability statement.
| Dimension | Reasoning | Score |
|---|---|---|
Specificity | The description lists many trigger phrases but doesn't clearly describe concrete actions the skill performs. It mentions concepts like 'set up monitoring', 'configure observability', 'create saved view' etc., but these are trigger terms rather than a clear statement of what the skill actually does (e.g., 'Creates monitoring dashboards, configures webhook integrations, sets up alert notifications'). | 2 / 3 |
Completeness | The 'when' is extensively covered with the long list of trigger phrases and the closing clause about setting up/configuring/managing the observability stack. However, the 'what does this do' is weak — there's no clear statement of the skill's capabilities or what it produces. It's essentially all trigger terms with no capability summary. | 2 / 3 |
Trigger Term Quality | Excellent coverage of natural trigger terms users would say, including variations like 'set up monitoring', 'configure observability', 'create saved view', 'set up Slack integration', 'configure PagerDuty', 'set up email alerts', 'webhook for alerts', etc. These are highly natural phrases a user would actually type. | 3 / 3 |
Distinctiveness Conflict Risk | The description is somewhat specific to observability/monitoring tooling, but the extremely broad list of triggers (webhooks, Slack integration, PagerDuty, email alerts, dashboards, extensions) could overlap with skills focused on specific integrations, notification systems, or dashboard management. The catch-all closing phrase 'manage the observability stack for a service or team' is quite broad. | 2 / 3 |
Total | 9 / 12 Passed |
Implementation
50%Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The skill provides a comprehensive CLI reference and reasonable workflow structure for observability setup, but suffers from two key gaps: the JSON payload examples are entirely missing (every command uses --from-file with no sample file contents), and the CLI reference tables are too large to be inline. The workflows would benefit from explicit validation checkpoints and error handling guidance.
Suggestions
Add example JSON payloads for at least the most common operations (e.g., a sample slack-connector.json, router.json, webhook.json) so Claude can actually construct the --from-file inputs.
Move the CLI command reference tables to a separate REFERENCE.md file and keep only the most essential commands inline in the workflows.
Add explicit validation/error-recovery steps in workflows, e.g., 'Verify connector was created: cx notifications connectors get <id> -o json. If creation failed, check error output and retry.'
Add a brief example of what successful test output looks like (e.g., expected output from cx webhooks test) so Claude can verify success.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The extensive CLI command tables are largely reference material that could be in a separate file. While each command is useful, the sheer volume (70+ commands listed) makes the skill quite long. The workflows themselves are reasonably concise, but the command tables dominate the document and could be better organized. | 2 / 3 |
Actionability | Commands are concrete and executable, but every `--from-file` command references JSON files (folder.json, view.json, slack-connector.json, etc.) without ever showing what those JSON files should contain. Without example payloads, Claude cannot actually execute these workflows — it would need to guess the JSON schema. | 2 / 3 |
Workflow Clarity | The workflows are clearly sequenced with numbered steps, and the Notification Setup Workflow includes a test step at the end. However, there are no explicit validation checkpoints or error recovery loops — e.g., what to do if `cx webhooks test` fails, or how to verify a connector was created successfully before proceeding to router creation. | 2 / 3 |
Progressive Disclosure | The skill references related skills (cx-create-dashboard, cx-incident-management, etc.) which is good, but the massive CLI command tables should be in a separate reference file rather than inline. No bundle files exist to offload this reference content, resulting in a monolithic document. | 2 / 3 |
Total | 8 / 12 Passed |
Validation
90%Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.
Validation — 10 / 11 Passed
Validation for skill structure
| Criteria | Description | Result |
|---|---|---|
frontmatter_unknown_keys | Unknown frontmatter key(s) found; consider removing or moving to metadata | Warning |
Total | 10 / 11 Passed | |
defdc4d
Table of Contents
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.