CtrlK
BlogDocsLog inGet started
Tessl Logo

authoring-scouts

How to author, edit, and adapt PostHog Signals scouts — the scheduled agents that scan a project and file what they find. Use to customize a canonical scout (narrow its scope, retune thresholds, add disqualifiers), tweak a scout's schedule or dry-run posture, write a new scout for a surface the fleet doesn't cover, build a measurement scout that records structured output (an LLM-judge scoring a sample on a schedule — a custom metric no query can compute), or steer a scout without editing it by leaving it a note. Covers the scout SKILL.md anatomy, the report contract, the structured-output channel, the dedupe + scratchpad-memory conventions, scout notes, the per-team skills-store path vs the canonical in-repo path, and the test loop. Trigger on "write/edit/customize a signals scout", "new scout for X", "tune my scout schedule", "make a scout that watches <event>", "score/judge/measure X with a scout", "structured output from a scout", "scout output to Slack", "leave a note for / give feedback to a scout".

66

Quality

81%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

—

The risk profile of this skill

SKILL.md
Quality
Evals
Security

Quality

Content

63%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A thorough, actionable instruction skill with clear sequenced workflows and concrete MCP tool calls, weakened by verbosity in the config section and by relying on five reference files that are not present in the bundle.

Suggestions

Tighten the Run posture section: move the per-field prose for lower-frequency config options (write_scopes, output_destinations, mcp_gateway_server_ids, repositories) into a reference file, keeping only the common fields and the discriminator guidance inline.

Ship the five referenced files (references/scout-anatomy.md, scout-patterns.md, report-contract.md, dedupe-and-memory.md, lifecycle-and-testing.md) in the bundle, since critical content like the frontmatter schema and report-contract bar is delegated to them and the links are currently dead.

In the Test loop, make the validation gates explicit and ordered (dogfood queries pass → create → run-now → inspect) as a numbered checklist with a hard 'do not spend a run before dogfooding' checkpoint, rather than advisory prose.

DimensionReasoningScore

Conciseness

The body is dense and on-topic (scout-specific, not general knowledge Claude already has), but the Run posture section runs very long with multi-paragraph field descriptions and repeated cautions that could be tightened or pushed to references; it fits 'mostly efficient but could be tightened' rather than the 4 anchor's 'minor instances'.

3 / 5

Actionability

Gives concrete, executable guidance — named MCP tools with JSON params (e.g. 'posthog:scout-run-now {"id": <config_id>}', 'posthog:scout-create'), exact field ranges (run_interval_minutes 30–43200) and scope names — with only minor gaps in fully-specified call signatures, fitting the 4 anchor.

4 / 5

Workflow Clarity

Multi-step flows are clearly sequenced with checkpoints — 'The job before the writing' (4 numbered steps), decision tables, and a dogfood → run-once → inspect test loop with feedback (refine → re-query → repeat); not a 5 because some validation is advisory rather than a hard gate and the workflow is spread across sections.

4 / 5

Progressive Disclosure

The body is well structured with five references that are one-level-deep and clearly signaled via markdown links plus one-line content descriptions, but none of the referenced files (references/scout-anatomy.md, scout-patterns.md, report-contract.md, dedupe-and-memory.md, lifecycle-and-testing.md) exist in the bundle, so the disclosure structure cannot be verified and critical content (frontmatter schema, report contract) is delegated to missing files.

3 / 5

Total

14

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, specific description that clearly states the skill's capabilities and gives explicit, natural trigger phrases for when to use it. Its only weakness is length: it runs long for a frontmatter description, which the skill's own body warns wastes token budget.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'customize a canonical scout (narrow its scope, retune thresholds, add disqualifiers), tweak a scout's schedule or dry-run posture, write a new scout..., build a measurement scout..., steer a scout without editing it by leaving it a note' — matching the comprehensive-coverage anchor rather than the 4 anchor's 'minor gaps'.

5 / 5

Completeness

Explicitly answers both what (author/edit/adapt scouts across multiple surfaces) and when (an explicit 'Trigger on' clause with concrete phrases), fitting the 5 anchor rather than the 4 anchor's 'when could be more explicit'.

5 / 5

Trigger Term Quality

Comprehensive natural trigger phrases a user would actually say — 'write/edit/customize a signals scout', 'new scout for X', 'tune my scout schedule', 'make a scout that watches <event>', 'score/judge/measure X with a scout', 'scout output to Slack', 'leave a note for / give feedback to a scout' — covering synonyms and surface variants.

5 / 5

Distinctiveness Conflict Risk

Targets a clear niche — PostHog Signals scouts — with distinct triggers and specialized vocabulary, so conflict risk with other skills is minimal.

5 / 5

Total

20

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

relative_links

Relative link issues: 7 missing

Warning

referenced_paths_exist

Referenced path issues: 16 missing

Warning

Total

13

/

16

Passed

Repository
PostHog/posthog
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.