Content
78%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A highly actionable, well-sequenced skill whose commands and config examples are copy-paste ready, with a useful anti-patterns table and honest limitations section. The main gap is structural: the assertion catalog and metric thresholds belong in a references/ file so SKILL.md can stay a lean overview, and the workflow lacks an explicit verify-before-gate step.
Suggestions
Move the full assertion catalog (deterministic, text-quality, model-graded tables and default thresholds) into a references/assertions.md file and keep only 3-4 representative examples inline, so SKILL.md reads as an overview.
Add an explicit validation step to the workflow, e.g., 'After promptfoo eval, check the exit code / open promptfoo view and confirm all asserts pass before committing the config or gating CI.'
Trim the repeated inline citation parentheticals ('Per [pf-gh][pf-gh]', '(Commands per [pf-gh][pf-gh])') and consolidate link definitions at the bottom to reduce token overhead.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense with commands, YAML snippets, and tables, and explains nothing Claude already knows. Minor over-explanation remains: repeated 'Per [pf-gh][pf-gh]' / '(Commands per [pf-gh][pf-gh])' citation parentheticals and the inline default-thresholds table could be trimmed. Fits 'Efficient; minor instances of over-explanation' rather than the every-token-earns-its-place anchor at 5. | 4 / 5 |
Actionability | Everything is executable: install commands, 'promptfoo init --example getting-started' + eval + view sequence, a complete minimal promptfooconfig.yaml, working assertion YAML for each category, and a full GitHub Actions 'with:' block. Copy-paste ready across all common cases, matching the top anchor. | 5 / 5 |
Workflow Clarity | Steps 1-8 form a clear install-to-CI sequence, but there is no explicit verification checkpoint (e.g., inspect the HTML report or eval exit code before treating the gate as passed). Fits 'Clear sequence with most checkpoints present; minor validation gaps' rather than 5, which requires explicit validation steps and feedback loops; the destructive/batch cap of 3 does not apply. | 4 / 5 |
Progressive Disclosure | No bundle files exist, and the full assertion catalog, text-quality metric thresholds, and CI action details are inlined in a ~280-line SKILL.md rather than split into references/ files. External doc links are well signaled in a References section, but reference material that clearly belongs in separate files is inline, matching the 'some structure; could be better organized' anchor rather than 4. | 3 / 5 |
Total | 16 / 20 Passed |