Content
77%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A highly actionable, well-sequenced compile-and-fix workflow with genuine validation loops and checklists. The weaknesses are structural: everything lives in one long SKILL.md (venue table and error-fix catalog would be better as reference files), plus a pseudocode step and dated venue versions that hurt token efficiency and shelf life.
Suggestions
Move the 'Common Venue Requirements' table and the Step 3 error-diagnosis catalog into one-level-deep reference files (e.g., references/venues.md and references/error-fixes.md), keeping SKILL.md as a lean overview that links to them.
Replace the Step 4 pseudocode loop with an executable bash loop (e.g., a for-loop re-running latexmk and grepping compile.log, bounded by MAX_COMPILE_ATTEMPTS=3) so every instruction is copy-paste runnable.
Drop the year-specific venue versions (ICLR 2026, NeurIPS 2025, ICML 2025) from the main body or move them to a dated reference file so the skill does not silently go stale.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense and command-first ("latexmk -pdf -interaction=nonstopmode -halt-on-error main.tex 2>&1 | tee compile.log", "pdfinfo main.pdf | grep Pages") with no explanation of concepts Claude already knows. Minor trims possible: the venue table carries year-specific entries ("ICLR 2026", "NeurIPS 2025", "ICML 2025") that will go stale, and per the guidelines time-sensitive info not in a deprecated/old-patterns section penalizes conciseness — keeping this at 4 rather than 5. | 4 / 5 |
Actionability | Mostly executable: real bash commands, a fully runnable pdftotext/python3 page-detection snippet, and concrete error-signature→fix pairs ("! LaTeX Error: File `somepackage.sty' not found" → "tlmgr install somepackage"). The gap is Step 4's pseudocode ("for attempt in 1..MAX_COMPILE_ATTEMPTS: compile() ... auto_fix()") and soft directives like "Suggest specific cuts", which keep it short of the copy-paste-ready 5 anchor. | 4 / 5 |
Workflow Clarity | An 8-step sequence with explicit validation checkpoints and a feedback loop: prerequisites check, "MAX_COMPILE_ATTEMPTS = 3" bounded fix-recompile loop, "Stuck after 2 attempts?" escalation path, post-compile checks ("PDF file exists and is > 100KB", "No '??' in the PDF"), page-count verification with the same-page edge case explained, stale-file detection, and a submission-readiness checklist. Matches the 5 anchor: clear sequence, validation steps, feedback loops, and checklists. | 5 / 5 |
Progressive Disclosure | No bundle files exist (no references/, scripts/, assets/) and no external references at all — the entire skill is a ~250-line monolith. Sections are well-organized, but content that clearly belongs in separate files is inlined: the 8-row venue-requirements table ("Common Venue Requirements") and the 9-entry error-fix catalog in Step 3. That matches the 3 anchor ('content that should be separate is inline'); it does not reach 4, which expects most content appropriately split with clear signaling to separate materials. | 3 / 5 |
Total | 16 / 20 Passed |