Content
92%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
Excellent operational content: fully executable commands and SQL for every common case, a well-sequenced workflow with real error-recovery loops, and clean one-level progressive disclosure into three verified reference files. The only improvement space is minor de-duplication between a few body sections and the reference files.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense with non-obvious operational facts Claude cannot know (retention limits, the epoch-nanosecond arithmetic because "the bundled DuckDB does not support TIMESTAMPTZ - INTERVAL", the 50 KB body-capture cap, "Refetching replaces whole records in DuckDB, clearing omitted fields") and explains nothing Claude already knows. It falls just short of the top anchor because a few sections — notably "Query JSON body fields" and the consumers example appearing as both a CLI command and SQL — partially duplicate content already covered in the reference files and could be trimmed. | 4 / 5 |
Actionability | Every workflow step and investigation pattern ships a fully executable command or SQL statement with realistic flag values, e.g. the metrics command with '--metrics '["requests","error_rate","response_time_p50","response_time_p95"]' --group-by '["method","path"]' --interval day --db' and the span query with 'epoch_ns(current_timestamp) - 86400000000000'. Filter JSON shapes, join keys, and exit-code recovery actions are all concrete and copy-paste ready, matching the top anchor; there are no pseudocode or placeholder gaps. | 5 / 5 |
Workflow Clarity | The six-step Investigation Workflow is clearly sequenced (identify app → time range → supporting data → fetch → query DuckDB → iterate) with explicit error-recovery loops: "If any command exits with code 3 (auth error), ask the user to run npx @apitally/cli auth", the legacy-schema recovery path requiring preservation or user permission before the destructive reset-db, and step 6's refine/refetch loop. Consistency rules ("Use this time range consistently... and SQL WHERE conditions") act as checkpoints, matching the anchor for explicit validation and feedback loops; the score-4 anchor's "minor validation gaps" does not apply. | 5 / 5 |
Progressive Disclosure | SKILL.md is a genuine overview: a brief command quick-reference inline, with the bulk (412-line command reference, DuckDB table schemas, JSON functions) split into three one-level-deep reference files that all exist and are clearly signaled with purpose descriptions ("full flags, fields, filters, and operators", "column types, relationships, and special types"). Anchored deep links like references/commands.md#traces resolve to real sections, matching the top anchor for well-signaled, appropriately split content. | 5 / 5 |
Total | 19 / 20 Passed |