Content
92%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exemplary lean, dense workflow that never explains what Claude already knows and defers all detail to purpose-labeled one-level-deep references. The only notable gap is that the validation step lacks the concrete test command that would make every phase executable.
Suggestions
Add the concrete command for running the affected operator/layer tests (and the --gate-k iteration form) so the validation gate is executable rather than descriptive.
Optionally show a one-line example of the analyzer invocation (scripts/analyze_profile.py <trace-dir>) beside the collector command, mirroring the pattern already used for collection.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The 47-line body is lean and assumes competence: no generic concepts are explained, every sentence carries operational information ('One run collects one aic_metrics set', 'Omit num_warps and num_stages from Ascend launches'), and non-obvious domain knowledge (grid limits, UB footprint, NaN poisoning) is exactly what Claude would not already know. Matches anchor 5; there is nothing to trim. | 5 / 5 |
Actionability | A copy-paste-ready profiler command with concrete flags, specific artifact names (op_statistic.csv, kernel_details.csv), and a named utility (fla.utils.ascend_ub_manager) make most guidance executable. A minor gap keeps it below anchor 5: the validation step ('Run kernel comparisons and the affected operator/layer tests') never shows the actual test invocation, leaving the final gate as a pointer rather than a command. | 4 / 5 |
Workflow Clarity | A clear five-step sequence (baseline → collect → diagnose → optimize → validate) with explicit checkpoints: baseline latency recorded before changes, 'Change one relevant factor, then measure whether the expected duration and pipe metrics moved', the full correctness gate required before reporting a speedup, and an explicit feedback loop ('If the expected metrics do not change, revisit the diagnosis before adding another optimization'). Matches anchor 5. | 5 / 5 |
Progressive Disclosure | The body is a concise overview with every deep detail pushed to one-level-deep, clearly-signaled references, and all six bundle files (reference.md, TRAPS.md, g-contiguous-loading.md, cases.md, analyze_profile.py, profile_npu.py) are referenced with a stated purpose and use condition (e.g., TRAPS.md 'when changing DMA paths, pointer arithmetic, or reused tl.dot operands'). Anchor links resolve to real headings (reference.md#collection-and-analysis, #diagnosis). Matches anchor 5. | 5 / 5 |
Total | 19 / 20 Passed |