Content
85%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-engineered orchestration skill body: complete polling-loop state machine, explicit validation gates, and correct use of scripts and references for detail. The residual weaknesses are minor — some cross-section repetition and one internal inconsistency between the HEAVY_FIELDS definition and the field names referenced in the fix_needs_review/fix_failed actions.
Suggestions
Add suggestedFixSummary and taskFailureSummaries (or correct names) to the HEAVY_FIELDS set so the fix_needs_review and fix_failed "Tool calls for actions" instructions match the defined field list.
Merge the "Tool calls for actions" details into the statuses-requiring-action table (or link them per row) to remove the duplication between that section and "Default Behaviors by Status".
State the gate check and new-CI-Attempt timeout rules once in a single "Key rules" location instead of repeating them across Default Behaviors, Main Loop, and Error Handling.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is almost entirely operational (tables, exact commands, state variables) with no explanation of concepts Claude already knows — e.g. the config table, anti-pattern table, and script invocations are all non-obvious, skill-specific content. It is not a 5 because of repetition: status behaviors appear in both the "Default Behaviors by Status" table and the "Tool calls for actions" list, and the gate check and new-CI-Attempt timeout rules are stated in multiple sections. | 4 / 5 |
Actionability | Fully concrete guidance: copy-paste script invocations with complete flag lists (e.g. the ci-poll-decide.mjs call with all --prev-* flags), exact MCP field sets and parameters, per-status default behaviors, and an error-handling table. Not a 5 because of a real gap: fix_needs_review and fix_failed instruct fetching "suggestedFixSummary" and "taskFailureSummaries", which are not in the defined HEAVY_FIELDS set (taskOutputSummary, suggestedFix, suggestedFixReasoning, suggestedFixDescription), leaving the exact select values ambiguous. | 4 / 5 |
Workflow Clarity | Clear sequence (Step 0 connection check → Step 1 init → Step 2 polling loop → Step 3 action handling → Step 4 cycle-check, with an explicit "run cycle-check before handling the code" ordering) and explicit validation checkpoints: Nx Cloud connection check, budget gate check before local fixes, cycle/timeout limits, circuit breaker, and retry-once error recovery. Destructive operations (git push, applying fixes) are guarded by the gate check and git-safety rules ("Stage specific files by name"), so the destructive-op validation cap does not apply. | 5 / 5 |
Progressive Disclosure | Appropriate split for an orchestrator skill: deterministic decision logic lives in scripts/ci-poll-decide.mjs and ci-state-update.mjs, detailed per-status fix handling is clearly signaled one level deep ("read references/fix-flows.md for the detailed flow" — a real 108-line file whose sections cover the delegated statuses), and all referenced paths exist. Navigation is easy and no content that belongs in a reference is inlined. | 5 / 5 |
Total | 18 / 20 Passed |