Content
88%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A strong, highly actionable body: the phased workflow is explicit with real validation checkpoints and a genuine iterate/measure feedback loop, and almost all guidance is executable as written. The main costs are token weight from the inlined meta-prompt template and a generic best-practices section Claude largely already knows.
Suggestions
Move the 70-line optimization meta-prompt template (Phase 3) to a bundle file such as references/optimization-metaprompt.md and keep a 3-4 line summary with the placeholder list in SKILL.md, cutting roughly a sixth of the always-loaded context.
Drop or drastically trim the 'Prompt Engineering Best Practices' table — personas, delimiters, few-shot examples, and reasoning instructions are knowledge Claude already has; keep only the Arize-specific rows such as variable preservation ({var} vs {{var}}).
Show the full `ax experiments create` invocation (with dataset, prompt, and space arguments) in Phase 4 or the Iterate workflow instead of the elided `ax experiments create ...`, since running an experiment is the one step of the loop without a copy-paste command.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense and command-driven (ax CLI invocations, jq scripts, tables of span attributes) with little padding, but two sections could be trimmed: the 'Prompt Engineering Best Practices' table restates techniques Claude already knows (personas, delimiters, few-shot examples, reasoning instructions), and the Workflows section repeats commands already shown in Phases 1-3. This fits 'Efficient; minor instances of over-explanation that could be trimmed' — not level 5, since not every token earns its place, and not level 3, since the excess is limited rather than an unnecessary explanation woven into the operational content. | 4 / 5 |
Actionability | Nearly everything is copy-paste ready: complete `ax spans export PROJECT --filter ... -l 10 --stdout` commands, full jq join/select scripts with exact attribute paths, a complete fill-in-the-blanks optimization meta-prompt, and a troubleshooting table mapping exact errors to solutions. The common cases (failing trace, dataset+experiment, wrong format, RAG hallucination) each get worked examples. This matches 'Fully executable; copy-paste ready code or commands; specific examples cover the common cases'; the only elision is `ax experiments create ...`, which is minor relative to the overall coverage. | 5 / 5 |
Workflow Clarity | The four phases are clearly sequenced (Extract → Gather → Optimize → Iterate), and validation checkpoints are explicit: after optimization, 'Verify all template variables are preserved', 'Check that format instructions are intact', 'Test on a few examples before full deployment'; Phase 4 closes the loop with failure analysis, score comparison, flipped-example counting, and regression checks ('Check for regressions -- examples that passed with prompt A but fail with prompt B'). The iterate loop plus troubleshooting table provides the error-recovery feedback loop the level-5 anchor requires; level 4 would require some of these checkpoints to be missing or implicit, which they are not. | 5 / 5 |
Progressive Disclosure | References are real, one level deep, and clearly signaled ('see references/ax-setup.md', 'follow references/ax-profiles.md' — both files exist in the bundle, and there are no scripts/ or assets/ directories), and section headers make navigation easy. However, ~450 lines is large for SKILL.md: the 70-line meta-prompt template and the generic best-practices table are inlined content that arguably belongs in reference files, and no such split is offered. This fits 'Good structure; most content is appropriately placed; references mostly clear; minor organization gaps' rather than level 5's 'content appropriately split'. | 4 / 5 |
Total | 18 / 20 Passed |