CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

signals-scout-data-pipelines

Signals scout for PostHog data pipelines — CDP destinations and transformations, batch exports, and hog flows. Watches for delivery failures, degraded functions, and stalled exports against each pipeline's baseline.

60

Quality

76%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

—

The risk profile of this skill

Fix and improve this skill with Tessl

tessl review fix ./products/signals/skills/signals-scout-data-pipelines/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is an exceptionally actionable, well-sequenced operational runbook dense with domain-specific signal and copy-paste SQL/tooling, with only minor trimmable framing prose. Its main weakness is progressive disclosure: everything lives in one ~220-line file with no reference offloading.

Suggestions

Move the 'MCP tools' catalog into a references/ file (e.g. references/tools.md) and keep a one-line pointer in the body, reducing inline reference bulk and lifting progressive disclosure.

Tighten the opening framing paragraph ('A pipeline is a promise...') to the essential signal-vs-noise model to push conciseness toward the 5-anchor.

Consider extracting the detailed Explore pattern catalog (watcher interventions, delivery-failure shift, batch exports, flow concentration) into a references/patterns.md referenced one level deep.

DimensionReasoningScore

Conciseness

The body is dense with PostHog-specific signal Claude would not already know (watcher state codes, HogQL footguns, MCP tool signatures, dedupe key conventions) and avoids explaining generic concepts; only minor framing prose ('a pipeline is a promise that data flows somewhere else') could be trimmed, sitting above the 3-anchor but short of the 5-anchor's fully lean ideal.

4 / 5

Actionability

Provides copy-paste-ready SQL (the batch_exports count and roster queries), exact MCP tool calls with JSON params and pagination notes, concrete thresholds (share >= ~10% over 24h with >= ~50 triggered), and explicit footguns — fully executable guidance covering the common cases per the 5-anchor.

5 / 5

Workflow Clarity

A clearly sequenced run (Get oriented -> Explore -> Save memory -> Decide -> Close out) with a Disqualifiers checklist, a profile-shape decision table, and confirm-before-file validation; the validation is advisory ('use judgment, these are the rails') rather than a hard gate, so it stays just below the 5-anchor's explicit gated checkpoints.

4 / 5

Progressive Disclosure

The body is a ~220-line monolithic file with no reference files (references/scripts/assets absent); reference-like content such as the MCP tools catalog and detailed Explore patterns is inlined rather than offloaded to one-level-deep files, fitting the 3-anchor's 'content that should be separate is inline' despite decent section organization.

3 / 5

Total

16

/

20

Passed

Description

66%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific and well-targeted to a clear PostHog niche with strong domain keywords, but it omits an explicit 'Use when...' trigger clause, which caps completeness at 3. Adding a concrete usage-trigger sentence would lift completeness and likely trigger_term_quality.

Suggestions

Append a 'Use when...' clause naming the natural trigger phrases (e.g. 'Use when investigating PostHog data pipeline delivery — CDP destination/transformations failing, batch exports stalled or failing, hog flows erroring for recipients').

Add common synonyms/extensions users might say (e.g. 'CDP', 'hog functions', 'warehouse exports', '.hog') to broaden trigger-term coverage toward the 5-anchor.

Disambiguate from sibling signals scouts inline (e.g. 'data-warehouse syncs and external-data failures belong to other scouts') to reduce overlap risk.

DimensionReasoningScore

Specificity

Names the domain ('PostHog data pipelines — CDP destinations and transformations, batch exports, and hog flows') and several concrete watch-actions ('delivery failures, degraded functions, and stalled exports'), with only minor coverage gaps, matching the 'lists several specific actions' anchor rather than the 3-anchor's '1-2 actions'.

4 / 5

Completeness

Has a clear 'what' (scouts pipeline delivery against baselines) but no 'Use when...' clause or equivalent explicit trigger guidance; per the guidelines a missing trigger clause caps completeness at 3, and it does not rise to the 4-anchor which requires both what and when.

3 / 5

Trigger Term Quality

Good keyword coverage of the natural PostHog-domain terms a user would say ('data pipelines', 'CDP destinations', 'transformations', 'batch exports', 'hog flows', 'delivery failures'), missing only synonyms/extensions, so it sits above the 3-anchor but below the 5-anchor's comprehensive synonyms.

4 / 5

Distinctiveness Conflict Risk

A clear, specific niche (PostHog CDP destinations/transformations, batch exports, hog flows) with distinct triggers and minimal conflict risk, but the body references sibling scouts (data-warehouse, health-checks) covering adjacent surfaces, so minor overlap risk keeps it just below the 5-anchor.

4 / 5

Total

15

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

14

/

16

Passed

Repository

PostHog/posthog

Path

products/signals/skills/signals-scout-data-pipelines/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.