CtrlK
BlogDocsLog inGet started
Tessl Logo

exploring-replay-vision-observations

Guides agents through pulling a Replay Vision scanner's observations, reading the findings, and acting on them — summarizing patterns across sessions, drilling into individual recordings, and turning real, corroborated issues into PostHog tasks, insights, or an investigating-replay hand-off. TRIGGER when: user wants to pull/read/triage Replay Vision observations, asks "what has my scanner found", wants to act on or summarize scanner findings, turn observations into tasks/work, or points at a /replay-vision/<scanner-id> URL. DO NOT TRIGGER when: creating or sizing a scanner (use creating-replay-vision-scanners), running a one-off scan you don't then analyse, or authoring a signals scout.

72

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured, actionable instruction-only skill with a clear sequenced workflow and explicit validation discipline. It scores solidly across dimensions, held just below top marks by minor tightening opportunities and the absence of a separate reference file for dense inline detail.

Suggestions

Tighten repeated corroboration guidance: the closing 'The discipline that matters' paragraph restates points already made in the Mental model and Step 4, so collapse it into a single concise reminder.

Extract the dense detail — the status/error_reason triage table and the per-scanner-type reading rules — into a references/ file (e.g. TRIAGE.md) so the main body stays a lean overview.

Add explicit error-recovery feedback loops for batch/destructive paths (e.g. 'if vision-quota-retrieve shows the budget exhausted, stop before triggering scans' and 'if an on-demand scan is rejected, surface the reason and retry once').

DimensionReasoningScore

Conciseness

Largely efficient and product-specific rather than explaining generic concepts Claude knows, but a few passages could be tightened (e.g. the closing 'The discipline that matters' paragraph restates the earlier corroboration point).

4 / 5

Actionability

Provides concrete executable guidance with exact MCP tool names and parameters (status=succeeded, min_score/max_score, order_by=-result_score, date_from/date_to with ISO 8601 / -7d / now, ?t=<seconds> from timestamp_ms/1000); minor gaps remain since it is prose guidance about tool calls rather than copy-paste code.

4 / 5

Workflow Clarity

Clear four-step sequence (Anchor → Pull → Read → Act) with validation checkpoints woven in ('corroborate before you act', check the ineligible mix before concluding, check quota before batch scans); lacks explicit error-recovery feedback loops, leaving it just short of a 5.

4 / 5

Progressive Disclosure

Well-organized sections with clearly signaled one-level skill references ([[investigating-replay]], [[creating-replay-vision-scanners]], [[inbox-exploration]]) and no nested refs; at ~150 lines some dense inline detail (the status triage table, per-type and per-action tool enumeration) could be split into a reference file.

4 / 5

Total

16

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is strong across all dimensions: concrete actions, natural trigger phrases, explicit what/when guidance, and a clearly distinct niche with boundary exclusions. It is a model example of the anchor examples.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — pulling observations, reading findings, 'summarizing patterns across sessions', 'drilling into individual recordings', and turning issues into 'PostHog tasks, insights, or an investigating-replay hand-off' — covering the workflow comprehensively.

5 / 5

Completeness

Explicitly answers both 'what' (the actions above) and 'when' with concrete 'TRIGGER when:' and 'DO NOT TRIGGER when:' clauses.

5 / 5

Trigger Term Quality

Includes natural user phrases ('what has my scanner found', 'turn observations into tasks/work'), the /replay-vision/<scanner-id> URL form, and explicit DO NOT TRIGGER exclusions, giving comprehensive natural-term coverage.

5 / 5

Distinctiveness Conflict Risk

Occupies a clear niche (reading/acting on Replay Vision observations) with distinct triggers and an explicit exclusion pointing the scanner-creation case to creating-replay-vision-scanners, minimizing conflict risk.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
PostHog/posthog
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.