Content
92%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exemplary instruction-only skill body: a hard login gate, a clear mechanism-selection decision list, incremental implementation with per-change read-back verification, and explicit unverified-means-stop boundaries. The only nit is mild redundancy in the login section's repeated stop/send-only instructions.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense, imperative, and assumes Claude's competence (no explaining what Weave or tracing is), but the login section restates the stop/send-only instruction already given at the top ('Send only this, and nothing else. No decisions, notes, plans, or documentation links') and repeats credential-handling cautions ('never read, print, or commit API keys' / 'never print, copy, or inspect secret values'). | 4 / 5 |
Actionability | Gives copy-paste-ready commands ('weave.init("entity/project")' in Python or 'await weave.init(...)' in Node, 'wandb login --verify --host <base-url>'), an exact user-facing reply template, and concrete check targets ('INTEGRATION_MODULE_MAPPING', 'integrations/hooks.ts', 'gen_ai.operation.name' values 'invoke_agent'/'chat'/'execute_tool'). Per the code-vs-instruction scoring note, deferring span code to real reference files is not penalized. | 5 / 5 |
Workflow Clarity | The sequence is explicitly gated (login check first, then inspect dependencies/agent boundaries/OTel provider, choose mechanism, implement one traced path at a time, then verify) with a real feedback loop: 'Fix mismatches and rerun the same check before continuing' and 'Empty results, failed queries, and unavailable checks are unverified, not passes. Stop at that boundary.' | 5 / 5 |
Progressive Disclosure | The body is a lean overview with six well-signaled, topical, one-level-deep references ([trace_fidelity](references/trace_fidelity.md), [Python](references/session_sdk_python.md) / [TypeScript](references/session_sdk_typescript.md) session SDKs, [auto-instrumentation caveats](references/otel_auto.md), [endpoint configuration](references/otel_endpoint.md), [read-back verification](references/read_back.md)), and all six files exist in ./references/ with no further nesting. | 5 / 5 |
Total | 19 / 20 Passed |