CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/synthetic-monitor-author

Drafts a synthetic monitor configuration for one critical user journey - picks the platform (Datadog Synthetics, Pingdom, Checkly, New Relic, etc.), authors the scripted-transaction body (Playwright-style for browser checks; HTTP-step for API checks), wires the cadence (typical 1-15 min), defines per-step assertions (DOM presence, API status, response shape) and aggregate alert thresholds (consecutive-failure count + on-call routing). Includes the RUM-coverage gap method for deciding which journeys to monitor: score real-user journeys from RUM / CrUX data by session volume times business value, diff against the existing monitor inventory, and emit a ranked gap list. Use when a critical journey needs continuous-in-production verification per ISTQB-canonical shift-right ("a test approach to test a system continuously in production"), or when synthetic coverage was never systematically derived from real usage data.

70

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Overview
Quality
Evals
Security
Files

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-organized, actionable skill body with a clear 8-step workflow and sound progressive disclosure. Marginal gains remain in trimming rationale prose, making the browser template complete, and adding an explicit post-authoring validation loop.

Suggestions

Tighten the Overview and RUM-gap rationale prose to assume Claude's knowledge of why production coverage matters, keeping only the method steps.

Add an explicit feedback loop in the as-code lifecycle (e.g., 'if `checkly test` fails, fix the script and re-run before deploy') to close the validation gap.

Either inline the full browser-check script or explicitly mark the excerpt as 'see monitor-templates.md for the complete spec' to remove ambiguity about copy-paste readiness.

DimensionReasoningScore

Conciseness

Dense and operational with minimal generic concept-explanation, but a few rationale passages (the gap-matter framing, the shift-right definition) add prose Claude could mostly infer.

4 / 5

Actionability

Concrete, mostly-executable code (Playwright excerpt, API-check YAML, alert config, CI commands) and real API endpoints, but the browser script is an explicit excerpt with placeholder comments rather than copy-paste complete in the body.

4 / 5

Workflow Clarity

Eight clearly numbered steps with validation gates (hard-reject on no RUM source, defer-if-low-score, smoke-check-before-deploy), though an explicit 'if test fails, fix and re-test' feedback loop after monitor authoring is implied rather than stated.

4 / 5

Progressive Disclosure

Well-structured overview with two real, one-level-deep reference files (monitor-templates.md, rum-source-queries.md) signaled inline at point of use and re-listed in References; full templates appropriately split out from inline sketches.

5 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A highly specific, well-triggered description that clearly states both capabilities and use conditions. The only soft spot is trigger-term breadth skewed toward practitioner jargon over lay phrasing.

DimensionReasoningScore

Specificity

Lists multiple concrete actions with comprehensive coverage — platform selection, scripted-transaction authoring (Playwright/HTTP-step), cadence, per-step assertions, alert thresholds, and the RUM-gap scoring/diff/rank method — exceeding the 5-anchor breadth.

5 / 5

Completeness

Explicitly answers both what (draft the monitor config + the RUM-gap method) and when ('Use when a critical journey needs continuous-in-production verification... or when synthetic coverage was never systematically derived from real usage data').

5 / 5

Trigger Term Quality

Strong practitioner keyword coverage ('synthetic monitor', 'Datadog/Pingdom/Checkly/New Relic', 'shift-right', 'RUM-coverage gap', 'CrUX') but leans technical, with a few everyday lay synonyms ('uptime check', 'ping my site') absent.

4 / 5

Distinctiveness Conflict Risk

Clear niche — authoring synthetic monitors from a RUM-derived gap list — with distinct triggers and minimal overlap risk, separable from sibling canary/experiment-validator skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents