CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

launchdarkly-experiment-guide

Guide a developer from 'I don't know what to test' to a ready-to-create LaunchDarkly experiment. Use when someone wants to run an experiment or A/B test but doesn't have a metric, a flag, or a hypothesis yet, or isn't sure what to measure. Scans the codebase and the connected LaunchDarkly account, proposes a hypothesis and metric from real context, wires up the flag and tracking code, then drafts the experiment and offers to create it. Built for engineers without a data-science or product-analytics background.

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-engineered orchestration skill: an unambiguous Step 0–8 workflow with preflight validation, confirm-before-write gates, post-create verification, precise tool/endpoint names, and clean one-level reference files. Its one real weakness is redundancy — the connection/fail-fast logic is repeated across five sections (Prerequisites, Step 0 prose, Step 0 table, Edge Cases, What NOT to Do), which inflates token cost without adding guidance.

Suggestions

State the connection-capability logic once — keep the Step 0 precedence list and table, and reduce the Prerequisites, Edge Cases, and What NOT to Do restatements to one-line pointers back to Step 0.

Include one short worked example of the tracking snippet and flag-evaluation snippet for the most common SDKs (or an explicit pointer to where in launchdarkly-metric-instrument / launchdarkly-flag-create to find them), so 'Give the user the snippet' steps are self-sufficient.

Trim the duplicated fail-fast messaging inside Step 0 itself (the blockquote after the precedence list repeats the table's Partial row) to a single sentence.

DimensionReasoningScore

Conciseness

Mostly efficient — the bulk is non-obvious, skill-specific guidance (MCP tool names, REST endpoints, field names) rather than concepts Claude already knows — but the connection-capability logic is restated five times: in Prerequisites ("Step 0 checks the specific capabilities and fails fast"), the Step 0 prose precedence list, the Step 0 "Capabilities by connection" table, the Edge Cases row ("Caught at Step 0 — fail fast"), and the What NOT to Do row. A careful tightening would cut at least two of these; it sits at level 3 ('could be tightened') rather than 2 because each restatement is short and the rest of the body earns its tokens.

3 / 5

Actionability

Concrete, executable guidance throughout: exact MCP tools ("MCP `list-flags` / REST `GET /api/v2/flags/{projectKey}`", `create-experiment`, `start-experiment-iteration`), exact commands (`git log --oneline -n 30`), specific REST payloads ("`POST /api/v2/projects/{projectKey}/environments/{envKey}/experiments` with the iteration body"), and field-level detail (`clientSideAvailability.usingEnvironmentId`, targeting `ruleId` + `flagConfigVersion`). Not 5 because the actual tracking-code and flag-evaluation snippets are only promised ("Give the user the tracking code snippet") and deferred to delegate skills/references rather than shown, leaving a minor gap in the copy-paste-ready sense.

4 / 5

Workflow Clarity

Clear Step 0–8 sequence with explicit validation checkpoints and feedback loops: a preflight that verifies specific capabilities before any work ("Verify the *specific* create tools exist at Step 0"), course-correction on user answers ("Correct course on their answer before continuing"), an unambiguous confirm gate before any write ("ask for explicit confirmation with clear options: *Create it* / *Change something* / *Just give me the steps*"), approval-gated starting ("start only after the approval request is approved"), and post-create verification ("verify (MCP `get-experiment` / REST `GET …/experiments/{key}`) and report"). Not 4: no checkpoint is missing or implicit — the writes are gated at every point a mistake could escape.

5 / 5

Progressive Disclosure

The body is a workflow overview with three well-signaled, one-level-deep references, each named with its purpose both inline at point of use ("See [Discovery guide](references/discovery.md) for what to grep for per stack") and in a dedicated References section; all three files exist and contain no nested references. The split is appropriate — workflow logic stays in SKILL.md while exact payloads, per-stack greps, and hypothesis templates live in the reference files. Not 4: navigation is easy and nothing that belongs in a reference is inlined in bulk.

5 / 5

Total

17

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A model description: concrete multi-action capability statement, an explicit 'Use when' clause with natural synonym triggers (experiment / A/B test), a clearly bounded LaunchDarkly niche, and third-person voice. It also honestly scopes the audience ("engineers without a data-science or product-analytics background") without over-claiming.

DimensionReasoningScore

Specificity

Lists multiple specific concrete actions with comprehensive coverage of the skill's flow: "Scans the codebase and the connected LaunchDarkly account, proposes a hypothesis and metric from real context, wires up the flag and tracking code, then drafts the experiment and offers to create it." Every stage (discover, propose, wire, draft, create) is named concretely; the level-4 anchor ('several specific actions, minor gaps') undersells it since no stage of the flow is missing.

5 / 5

Completeness

Explicitly answers both questions: what ("Guide a developer from 'I don't know what to test' to a ready-to-create LaunchDarkly experiment... drafts the experiment and offers to create it") and when ("Use when someone wants to run an experiment or A/B test but doesn't have a metric, a flag, or a hypothesis yet, or isn't sure what to measure"). The 'Use when' clause is present with concrete trigger conditions, matching the top anchor exactly.

5 / 5

Trigger Term Quality

Natural trigger phrases a user would actually say are comprehensively covered, including the key synonym pair "run an experiment or A/B test", plus "doesn't have a metric, a flag, or a hypothesis yet" and "isn't sure what to measure". Not level 4, because no common natural variation of the request is missing — 'experiment', 'A/B test', and the uncertainty framings cover how this need is expressed.

5 / 5

Distinctiveness Conflict Risk

Clear niche with distinct triggers: the description names LaunchDarkly explicitly and targets a specific situation (no metric/flag/hypothesis yet) that no generic analytics or feature-flag skill would claim. Third-person voice is used throughout ('Guide a developer', 'Scans the codebase'), so no voice penalty applies.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

launchdarkly/ai-tooling

Path

skills/experiments/launchdarkly-experiment-guide/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.