CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

experiments

Run, read, and compare dataset-backed experiments to find evidence that a prompt or pipeline is improving. Trigger when the user wants to iterate over a dataset with experiments, compare experiment runs, read experiment quality/latency/cost, or decide whether a change actually helped. Running a prompt over a dataset is implicitly an experiment — load this skill when dataset-backed work begins, before authoring evaluators for the experiment and before starting the recorded run, not only when reading results. Do NOT trigger on: (1) manual prompt drafting with no dataset-backed evaluation in scope (use `playground`), (2) authoring or refining an evaluator's logic or rubric (use `evaluators`), (3) cross-trace failure diagnosis with no experiment in scope (use `phoenix-error-analysis`).

68

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

73%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, disciplined process skill: a clear validated iteration loop with strong guardrails and no token waste. Its weakness is that every operational mechanic (how to start a run, read results, or compare runs) is delegated to other skills, leaving the body directionally concrete but not executable.

Suggestions

Add one short executable example per touchpoint — e.g., the command/API pattern for starting a recorded experiment with hypothesis/changed-variable/baseline metadata, or point to exactly where in the playground skill that mechanic lives.

Include a compact example of the metadata write-back (before/after JSON with hypothesis, changed variable, baseline, and a timestamped observation) so the read-modify-write rule is copy-pasteable.

Show a minimal per-example comparison table format (quality/latency/cost per example, baseline vs candidate) to make step 7's 'compare aligned, not by aggregate means' immediately actionable.

DimensionReasoningScore

Conciseness

The body is dense and free of padding, assuming Claude's competence (e.g., no explanation of what a dataset or prompt is; the opening definition of "experiment" is domain-specific, not generic filler). A few rhetorical sentences like "Experiments turn 'this prompt feels better' into evidence" could be trimmed, matching anchor 4 ("minor instances of over-explanation") rather than 5.

4 / 5

Actionability

Concrete decision rules are present (context belongs in `input` never `reference`, change exactly one axis, trust aggregates only at zero errors, read metadata then write back the whole object), but there are no executable mechanics anywhere: no commands, API calls, or code for actually running, reading, or comparing experiments — all delegated to sibling skills. Anchor 3 ("concrete guidance but incomplete; missing key details") fits better than 4, which requires concrete code or commands.

3 / 5

Workflow Clarity

A nine-step sequenced workflow with explicit validation checkpoints ("Make sure the starting prompt is well formed before running it", "Trust aggregates only when the run is complete with zero errors"), a genuine feedback loop (step 9's hypothesis → run → compare → report iteration), and a closing "Things To Avoid" checklist. The batch-operation validation cap does not apply since the zero-error checkpoint is explicit — matches anchor 5.

5 / 5

Progressive Disclosure

No bundle files exist, and the ~80-line body is cleanly sectioned (Before You Start / Workflow / Recording / Boundaries / Avoid) with mechanics appropriately delegated to sibling skills rather than inlined. It exceeds the under-50-line simple-skill exemption, so not a 5, but nothing is inlined that clearly belongs in a separate file — anchor 4 ("good structure; most content appropriately placed; minor organization gaps").

4 / 5

Total

16

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: concrete actions, explicit positive and negative trigger guidance with load timing, and named routing to adjacent skills. The only gap is a few natural synonyms (evals, benchmark) that users might say.

Suggestions

Consider adding one or two common synonyms users may say, such as "evals" or "benchmark a prompt", to the trigger phrases.

Optionally name the scoring/evaluator-annotation step among the listed actions so the iterate-loop's scoring phase is visible in the description.

DimensionReasoningScore

Specificity

"Run, read, and compare dataset-backed experiments" plus "read experiment quality/latency/cost" and "decide whether a change actually helped" name multiple specific concrete actions that comprehensively cover the skill's domain. Fits anchor 5 better than 4, since no capability area of the skill is left uncovered at the description level.

5 / 5

Completeness

Both what ("Run, read, and compare dataset-backed experiments") and when ("Trigger when the user wants to iterate over a dataset with experiments...") are explicit, and it goes further with load timing ("load this skill when dataset-backed work begins... before starting the recorded run, not only when reading results") and an explicit Do-NOT-trigger list. Clearly matches anchor 5.

5 / 5

Trigger Term Quality

Natural user phrases are well covered ("iterate over a dataset with experiments", "compare experiment runs", "decide whether a change actually helped"), but common synonyms such as "evals", "benchmark", or "A/B test" are missing. Anchor 4 ("good keyword coverage; a few natural terms missing") is the closest fit.

4 / 5

Distinctiveness Conflict Risk

The explicit negative-trigger list disambiguates three adjacent skills by name (`playground`, `evaluators`, `phoenix-error-analysis`), giving a clear dataset-backed-experiment niche with minimal conflict risk. Matches anchor 5.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

Arize-ai/phoenix

Path

src/phoenix/server/agents/prompts/skills/experiments/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.