Content
65%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-structured overview with an excellent progressive-disclosure setup and a copy-paste-ready Quick Start. The main costs are re-taught Spark fundamentals (execution model diagram, concept table) and the absence of a sequenced diagnostic workflow with monitoring/validation checkpoints — optimization guidance is presented as patterns to know rather than a process to follow.
Suggestions
Cut the 'Spark Execution Model' section and trim the Key Performance Factors table to only non-obvious guidance; Claude already knows the driver/job/stage/task model.
Add a short numbered diagnostic workflow (e.g., check Spark UI for skew/spills/GC → apply the matching pattern from references/details.md → re-run and verify improvement) to give the patterns a validation loop.
Inline one or two-line code snippets for the highest-value best practices (broadcast join, salting) so the main file is self-sufficient for the most common fixes.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Mostly efficient — the Quick Start, factor table, and do's/don'ts are tight — but the 'Spark Execution Model' ASCII diagram and the explanatory factor table re-teach concepts (driver/job/stage/task, what shuffle and skew are) that Claude already knows. Not 4 because a whole section plus part of the table is trimmable over-explanation; not 2 because there is no padded prose or library introductions. | 3 / 5 |
Actionability | The Quick Start is complete, executable PySpark with real config keys (AQE, Kryo, shuffle partitions) and an end-to-end read/transform/write example, and best practices include concrete numbers ('128MB - 256MB per partition'). Not 5 because several recommendations ('Salting, broadcast joins', 'Manual salting') have no inline example — the code lives only in the reference file. | 4 / 5 |
Workflow Clarity | Content is organized by concept rather than as a sequenced process; there is no diagnostic workflow (e.g., inspect Spark UI → identify skew/spill → apply pattern → re-check) and no validation checkpoints, only a one-line 'Monitor Spark UI' bullet. It exceeds 2 because the section flow (when-to-use → concepts → quick start → details → best practices) gives a rough order, but the anchor for 3 — steps present but checkpoints missing — is the best fit. | 3 / 5 |
Progressive Disclosure | SKILL.md is a lean overview (~96 lines) with one clearly signaled, one-level-deep reference: 'Detailed pattern documentation lives in `references/details.md`. Read that file when the navigation tier above is insufficient.' The bundle matches — references/details.md exists (321 lines) and contains no nested .md references — so navigation is easy and appropriately split. | 5 / 5 |
Total | 15 / 20 Passed |