Content
92%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A lean, well-structured instruction skill with concrete tool-specific rules, pre-flight layout validation, and a real failure-recovery loop. The only notable gap is the lack of an example vasp_execute_batch invocation showing its parameters.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The ~48-line body is lean and assumes competence: bullets like 'A calc folder is identified by INCAR and POTCAR' and 'Read _BATCH_STATE.json first' convey tool-specific facts with zero padding, no explanation of what VASP or batch processing is, and no filler. Every token earns its place, matching the level-5 anchor; level 4 ('minor instances of over-explanation') does not apply since nothing is trimmable. | 5 / 5 |
Actionability | Concrete, specific guidance throughout: which tool to call ('Use vasp_execute_batch; do not use deprecated vasp_execute'), explicit path constraints ('output_dir must not be inside input_dir'), and a concrete failure protocol ('Read _BATCH_STATE.json first... Rerun only the failed subset, again into a fresh output root'). Per the rubric's code-vs-instruction note, absence of code is not penalized, but there is no example invocation of vasp_execute_batch (parameter names like input_dir/output_dir are referenced but never shown in a call), leaving a minor gap versus the fully copy-paste-ready level-5 anchor — hence 4, not 5; it is clearly above level 3's pseudocode/incomplete level. | 4 / 5 |
Workflow Clarity | The numbered workflow (validate layout → avoid illegal layouts → submit and collect → triage failures) has explicit validation steps: step 1 validates the execution layout, step 2 enumerates the illegal layouts as a checklist, and step 4 is a genuine feedback loop (read _BATCH_STATE.json → inspect focused evidence → rerun only the failed subset into a fresh output root). The batch-operation cap at 3 does not apply because validation and error-recovery loops are present, matching the level-5 anchor ('explicit validation steps; feedback loops for error recovery; checklists'). | 5 / 5 |
Progressive Disclosure | The skill is under 50 lines, single-purpose, with no bundle files (references/, scripts/, assets/ do not exist) and no need for external references; per the rubric's simple-skill note it scores 5 with well-organized sections, which it has: Overview, Quick Start, Suggested tools, a four-part Workflow, Output Contract, and a closing usage note. Sections are clean and navigable with no inlined content that belongs in a separate file. | 5 / 5 |
Total | 19 / 20 Passed |