Content
70%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
This is a strong, unusually rigorous operational skill: executable templates, exact commands, named audit gates, and explicit validation/feedback loops. Its weaknesses are a 640-line monolithic structure with no reference files to split major policy areas into, and scattered redundancy (tautological sections, a closing checklist duplicating inline rules).
Suggestions
Split the 'Resolved Secrets and Provenance Boundaries' policy and the 'Wiring Tools into the Block' guide into references/ files (e.g. references/provenance.md, references/block-wiring.md), keeping SKILL.md as a lean overview with one-level-deep, clearly signaled pointers.
Delete the tautological 'Required vs Optional' subsection and inline '// Use false for optional' comments; the rule 'always explicitly set required' alone is sufficient.
Add a code template for the in-process handler (apps/sim/lib/internal/{service}/execute-tool.ts) mirroring the external ToolConfig template, so both execution paths are copy-paste ready.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense with project-specific constraints Claude cannot know (boundary rules, provenance policy, audit commands) and avoids explaining general concepts, but it has several padded spots: the tautological 'Required vs Optional' section ('Always explicitly set required: true or required: false / Optional params should have required: false'), a '// Use false for optional' comment, and a final checklist repeating ~10 rules stated verbatim earlier. This is 'could be tightened' territory (anchor 3) rather than minor trimming (anchor 4). | 3 / 5 |
Actionability | Guidance is highly concrete: complete TypeScript config templates for both external and internal boundaries, exact file paths, and exact commands ('bun run generate:tool-metadata', 'bun run check:tool-request-boundary', 'bun run apps/sim/scripts/check-block-registry.ts origin/staging'). The gap that keeps it from a 5: the in-process handler implementation (execute-tool.ts) — half of one execution path — is described only in prose, never shown as code. | 4 / 5 |
Workflow Clarity | Sections are ordered in execution order (structure → config → params → outputs → types → barrel → registering → block wiring → checklists → final validation), with explicit validation steps (named audit scripts plus a required 'Final Validation' cross-reference pass), a genuine error-recovery branch ('If the docs do not clearly show the response JSON... stop short of guessing' with four concrete fallbacks), and checklists for both block wiring and completion. This matches the anchor-5 example's structure of sequence + validation + feedback loops + checklists. | 5 / 5 |
Progressive Disclosure | The single SKILL.md is ~640 lines with well-organized headers but no bundle references at all (no references/, scripts/, or assets/ exist); large distinct topics — the ~60-line provenance policy and ~150-line block-wiring guide — are inlined where separate reference files clearly belong. Structure is good (above anchor 2's 'minimal structure'), but 'most content is appropriately placed' (anchor 4) does not hold for a monolith of this size. | 3 / 5 |
Total | 15 / 20 Passed |