Content
88%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A highly actionable, well-sequenced merchant onboarding skill: exact commands, complete GraphQL mutations, explicit wait-for-user checkpoints, and validate-preview-confirm loops around every batch mutation. Its main weaknesses are mild redundancy (duplicated install command and shell-safety note, long dialogue templates) and a monolithic single-file layout where platform-specific tables and constraints would fit naturally in on-demand reference files.
Suggestions
Deduplicate the repeated guidance: state the 'write variables JSON to a temp file, never inline merchant data' rule once, and reference the single npm upgrade command instead of repeating it in the failure path.
Move the per-platform material (supported-platforms notes, export paths, validation-guide links, and validation constraints) into a references/ file (e.g., platforms.md) fetched only after the merchant names a platform, keeping SKILL.md as a lean overview plus routing table.
Tighten the scripted response templates (menu wording, example prompts) to shorten the ~540-line body without losing the tone-control intent.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense and operational — nearly every line is an instruction, exact command, table, or scripted response, with no explanation of concepts Claude already knows. Minor trimming is possible: the 'write variables JSON to a file' rule is stated twice ('Write the variables JSON to a temporary file...' followed by '**Important:** Never inline merchant data...'), the npm install command appears twice, and some scripted dialogue templates are longer than needed. Fits anchor 4 (efficient, minor over-explanation) rather than 5. | 4 / 5 |
Actionability | Fully executable throughout: exact install commands ('npm install -g @shopify/cli@latest', 'brew tap shopify/shopify && brew install shopify-cli'), the exact auth command with normalized store handle, complete GraphQL query strings for productSet and inventorySetOnHandQuantities including the @idempotent directive, concrete JSON structures for single- and multi-variant products, per-platform export click-paths, and explicit shell-safety handling for merchant data. Copy-paste ready for the common cases. | 5 / 5 |
Workflow Clarity | Clear sequenced workflow (Steps 1-4, auth, import) with explicit validation checkpoints at every risky point: wait-for-user gates, a dedicated CSV validation stage distinguishing blocking errors from warnings, a preview-and-confirm step before any mutation, and feedback loops for recovery (auth failure -> upgrade CLI -> retry; 'If there were errors, offer to retry the failed products'). The batch import operation is validated both before (CSV validation) and after (error reporting, retry offer), so the batch-operation cap does not apply. | 5 / 5 |
Progressive Disclosure | Good structure: heavy per-platform detail (column mappings, validation steps) is deferred to on-demand fetched guides, with compact routing tables in SKILL.md serving as the index, and sections are clearly headed and easy to navigate. However, no bundle files exist (references/, scripts/, assets/ are absent), and several sizable inlined blocks — the scopes table, validation constraints table, supported-platform/export-path/validation-guide triple tables, and known-limitations table — plus ~540 lines total could partly live in reference files fetched only when the merchant names a platform. Fits anchor 4 rather than 5. | 4 / 5 |
Total | 18 / 20 Passed |