Content
77%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body delivers exceptional actionability and workflow discipline — discovery-first querying, parameter sweeps, silent-default warnings, and verification loops are all exemplary. Its weaknesses are the two structural ones: the 59KB monolithic body inlines what belongs in reference files (only scripts/help.py and external WebFetch URLs provide offloading), and a few sections (numpy/scipy/matplotlib, exhaustive CRUD listings) restate knowledge Claude already has.
Suggestions
Move the full API signatures (Workspace/query engines, legacy queries, entity CRUD listings, Key Types) into a references/api.md (or lean on help.py plus a short index), keeping SKILL.md to the quick-start, discovery workflow, and analytical guidance — this would cut the always-loaded body dramatically.
Trim or delete the 'Statistical Analysis — numpy, scipy' and 'Visualization — matplotlib, seaborn' sections to one-line pointers (e.g., 'results are DataFrames; use Agg backend for saved charts'), since Claude already knows this material.
Replace the exhaustive per-entity CRUD method name listings with a single 'python3 $SKILL_DIR/scripts/help.py search <entity>' instruction plus one small example, so the CRUD surface stays discoverable without inlining every method name.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is ~1060 lines and most of it earns its place (Mixpanel-specific signatures, silent-default traps, regex-engine quirks), but the 'Statistical Analysis' and 'Visualization' sections re-explain t-tests, Cohen's d, matplotlib's Agg backend, and seaborn functions Claude already knows, and the bulk of the API/CRUD reference (every entity method name, full legacy query signatures) could be tightened or delegated to help.py and the linked full references. Not 4: this is more than 'minor instances of over-explanation' — the body is a 59KB monolith. Not 2: it is not padded with generic conceptual explanation; nearly everything is library-specific and non-inferable. | 3 / 5 |
Actionability | Fully executable guidance throughout: complete method signatures with per-parameter comments, copy-paste runnable sweeps (MathType sweep, conversion-window sweep, cardinality sweep, aggregate sweep), exact `python3 $SKILL_DIR/scripts/help.py <Name>` commands with expected output, and a working `CreateCustomPropertyParams(...)` example. Placeholders like `event = 'Purchase' # use a real event name` are deliberate and backed by the discovery workflow, so there are no real gaps. Not 4: the common cases are covered concretely, not just 'mostly'. | 5 / 5 |
Workflow Clarity | Sequences are explicit with validation checkpoints and feedback loops: 'Discovery — ALWAYS Do Both Steps Before Querying' (guessing causes 'silent empty results'), the five-step exploratory workflow, custom-property creation with 'Verify by querying with the custom property as group_by', and a checklist of analytical principles in 'Multi-Step Analysis Patterns'. Not 4: checkpoints are explicit rather than merely present — error recovery is directly addressed (wrong parameter names → TypeErrors → run help.py first). The CRUD section is a method inventory, not a destructive workflow, so the destructive-cap does not apply to the described workflows. | 5 / 5 |
Progressive Disclosure | There is good section structure and genuine on-demand references (help.py as a real bundled lookup tool, one-level-deep WebFetch guides, llms.txt), but the core API reference — full Workspace/query/funnel/retention signatures, every CRUD entity method, legacy queries, and the entire custom-property formula language — is inlined into SKILL.md rather than split into reference files, making it load in full on every invocation. Not 4: 'content that should be separate is inline' describes most of the body, which is the anchor-3 condition. Not 2: references are clearly signaled and the document is well sectioned, not unstructured. | 3 / 5 |
Total | 16 / 20 Passed |