Content
86%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A tight, expert-level instruction skill: invariant-driven procedure, explicit test matrix, approval gate for live money, and measurable exit criteria, with no wasted tokens. It is instruction-only rather than code-bearing, so the residual gap is executable specificity — the actual CLI commands and an explicit retry-on-failure loop are left to the reader.
Suggestions
In step 5, include the one or two concrete provider-CLI commands (or the test-clock invocation) so the test matrix is copy-paste executable rather than implied.
Add a single recovery line after the test matrix, e.g. 'If a scenario fails, fix the grant logic and re-run all six before repair,' to close the validate-fix-retry loop the workflow otherwise implies.
Name the signature-verification method (or point to where it is documented) so 'verify signatures' is actionable across providers rather than a stated invariant.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is lean and assumes competence: every line is an invariant or instruction ('verify signatures, dedupe on event ID', 'Never put paid content in unpaid HTML or JSON', 'One price constant from the approved offer') with zero concept explanation and no padding. It matches the score-5 anchor (every token earns its place); even the parenthetical '(an over-broad refund fix was a benchmark cheat)' is two words of real signal about a known failure mode rather than fluff. | 5 / 5 |
Actionability | Guidance is concrete and executable in intent — named test scenarios ('success, decline, 3DS, replay, reorder, invalid signature; use test clocks'), a defined reconciliation equation ('provider charges = internal orders = entitlements'), and a named repair path ('repair them through `fix-data-repair`'). It sits at the score-4 anchor rather than 5 because no actual commands are given (e.g., the specific provider-CLI invocations or signature-verification method), leaving minor gaps between instruction and execution. | 4 / 5 |
Workflow Clarity | A clear 7-step procedure with explicit validation: the enumerated TEST-mode scenario matrix, the 'Live money actions need approval' gate for risky operations, a defined repair step, and an 'Exit criteria' checklist ('zero orphans', 'isolation holds'). This satisfies the score-4 anchor (clear sequence, most checkpoints present) but not score-5: there is no explicit error-recovery loop after a failing test scenario, and the steps read more as invariants than an ordered loop. | 4 / 5 |
Progressive Disclosure | The skill is under 50 lines with no bundle files (references/, scripts/, assets/ are absent), and the body is well organized into 'Procedure' and 'Exit criteria' sections. Per the rubric's simple-skill guideline, this scores 5; its only cross-references ('fix-data-repair', 'qa-payments-billing') are clearly signaled and one level deep. | 5 / 5 |
Total | 18 / 20 Passed |