CtrlK
BlogDocsLog inGet started
Tessl Logo

exploring-scouts

How to explore and make sense of PostHog Signals scouts — the scheduled agents that scan a project and write reports into the Signals inbox. Use when a user wants to understand what scouts they have, how each one is behaving, and whether the fleet is actually working. Covers surveying the fleet and its schedules, reading recent scout runs and drilling into a single run's reasoning, inspecting the durable scratchpad memory the fleet has built up, tracing a run to the reports it wrote or edited, and assessing a scout's health and performance over time (cadence, success rate, report rate, signal-to-noise). Read-only and exploratory — to write or tune a scout, use `authoring-scouts` instead. Trigger on "what are my scouts doing", "how is my <x> scout performing", "show me recent scout runs", "why did this scout find/report nothing", "what has the fleet learned", "explore scout run <id>", "is my scout working".

73

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

85%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A thorough, highly actionable read-only exploration skill with clear sequenced workflows and well-structured progressive disclosure. Its main weakness is repetition and length — several caveats are restated multiple times and could be consolidated.

Suggestions

Consolidate the legacy `emitted_count` / `emitted_finding_ids` explanation into one place (currently at lines ~31, ~170, and ~336) and cross-reference it instead of re-explaining each time.

Merge the dispatch-vs-execution (`last_run_at` vs run row) caveat, which appears in both 'Start here' and the health workflow, into a single canonical explanation.

Consider moving the deep session-log reconstruction guidance (exclude_types caveat, full-vs-truncated log) into a reference file to shorten the main body.

DimensionReasoningScore

Conciseness

The content is high-signal domain knowledge Claude lacks, but it repeats the legacy `emitted_count` caveat three times and the dispatch-vs-execution divergence twice, and the ~327-line body could be tightened without losing clarity.

2 / 3

Actionability

Concrete tool names, exact field names, runnable JSON call blocks, and copy-paste script invocations with flags give fully executable, specific guidance throughout.

3 / 3

Workflow Clarity

Each workflow is explicitly sequenced with decision checkpoints — the 'Start here' three-case branch, cross-checking `last_run_at` against run rows, and checking `edited_report_ids` before declaring a run quiet — providing clear feedback for error recovery.

3 / 3

Progressive Disclosure

Overview points to verified one-level-deep references (`references/scout-data-model.md`, `references/assessing-performance.md`) and bundled scripts (all present), with the full field reference and performance playbook appropriately externalized.

3 / 3

Total

11

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A high-quality description: specific, trigger-rich, complete on both what and when, and cleanly distinguished from sibling authoring/inbox skills. Third-person voice is maintained throughout.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — surveying fleet/schedules, reading recent runs, drilling into a single run's reasoning, inspecting scratchpad memory, tracing runs to reports, and assessing health (cadence, success rate, report rate, signal-to-noise).

3 / 3

Completeness

Clearly answers both 'what' (explore/understand scout fleet behavior and health) and 'when' via an explicit 'Use when a user wants to understand…' clause plus trigger guidance.

3 / 3

Trigger Term Quality

Provides explicit quoted natural-language triggers users would say ('what are my scouts doing', 'show me recent scout runs', 'is my scout working', etc.) with good coverage of phrasing variations.

3 / 3

Distinctiveness Conflict Risk

Carves a clear read-only/exploratory niche and explicitly diverts write/tune work to `authoring-scouts`, with distinct scout-specific triggers unlikely to fire for other skills.

3 / 3

Total

12

/

12

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

referenced_paths_exist

Referenced path issues: 2 missing

Warning

Total

14

/

16

Passed

Repository
PostHog/posthog
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.