Content
86%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A dense, well-structured body that delivers project-specific contracts, executable commands, explicit validation checkpoints, and correctly deferred one-level-deep references. The only meaningful gap is that some verification procedures (gradcheck usage, baseline reproduction, routing verification) are directed at rather than shown.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The ~30-line body is lean with zero padding: every sentence carries repo-specific contract knowledge Claude cannot infer (e.g., "The NaN allocation guard covers eligible FLA allocations in operator/module tests, including the single-rank CP graph and intra-card cache cases..."). No basic concepts are re-explained. | 5 / 5 |
Actionability | Copy-paste-ready commands ("python scripts/find_dependent_tests.py fla/ops/kda/chunk.py", "FLA_CI_ENV=0 pytest tests/ops/test_kda.py -v") plus a concrete coverage-dimension table make the guidance mostly executable. Not 5 because how to concretely execute gradient checks, routing verification, and baseline reproduction is directed but not shown. | 4 / 5 |
Workflow Clarity | A clear select-coverage -> run-affected-paths sequence exists with explicit validation checkpoints ("Inspect skips and warning-only comparisons before calling the run a pass", "reproduce failures on the unchanged baseline before labeling them pre-existing", "investigate a poisoned-run failure even when an ad hoc run passes"). Not 5 because the sequence is prose-embedded rather than an explicit ordered workflow with feedback loops. | 4 / 5 |
Progressive Disclosure | The body is a concise overview with well-signaled, one-level-deep references: the four operator-math files (delta-rule, generalized-delta-rule, simple-gla, cp) all exist under references/ and are gated by "Read operator math only when needed". Good-overall-example structure (lean sections, deferred detail) is matched. | 5 / 5 |
Total | 18 / 20 Passed |