Content
43%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body has a workable skeleton (quick-reference patterns plus clearly listed one-level-deep reference files), but it is undermined by non-executable code blocks (bare config keys, import-less signatures), template boilerplate, the complete absence of a fine-tuning workflow, and pointers to reference files and directories that do not exist in the bundle.
Suggestions
Replace the bare-key code blocks (Pattern 3's 'context_parallel_size', Pattern 6's 'integrations') and the signature-only Examples 1-5 with complete, executable snippets including imports or full YAML context.
Add a basic sequenced workflow, e.g., pick a dataset format -> write the YAML config (link reference) -> launch training -> monitor -> save/export, so users have an ordered path through the skill.
Fix navigation: remove or correct the pointers to nonexistent 'getting_started'/'tutorials' reference files and the placeholder scripts//assets/ sections, and delete the template boilerplate ('When to Use This Skill', 'Notes', 'Updating') that adds no guidance.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The quick-reference patterns are dense and carry real information, but the body includes several padded template sections: the trivial 'When to Use This Skill' bullet list ('Working with axolotl', 'Asking about axolotl features'), the placeholder 'Add helper scripts here' text, and the auto-generation Notes/Updating sections about re-running a scraper. Not a 2 because there is no concept-explanation padding and the core content is efficient. | 3 / 5 |
Actionability | Mixed concreteness: Pattern 2 (full FSDP YAML snippet), Pattern 1 (executable NCCL test command), and Pattern 7 (utils.trainer.drop_long_seq call) are concrete, but Patterns 3 and 6 use code blocks containing only a bare config key ('context_parallel_size', 'integrations'), Pattern 4's explanation is crammed into a run-on sentence with a trivial code block, and Examples 1-5 are bare function signatures with no imports or context. Not a 4 because a substantial share of the code blocks are not executable as written. | 3 / 5 |
Workflow Clarity | There is no sequenced workflow for the skill's core task (write a YAML config, launch training, monitor/evaluate, export the model); only vague navigation ('Start with the getting_started or tutorials reference files'). The rough 'beginners -> category references -> code examples' organization gives a rough sequence, but steps are poorly defined with many gaps, and the beginner entry point references files that do not exist. Not a 1 because the body is coherent and provides an intended reading order. | 2 / 5 |
Progressive Disclosure | The reference files are clearly listed in a dedicated section with one-line descriptions and are one level deep, and all three listed files (api.md, dataset-formats.md, other.md) exist. However, the body points beginners to 'getting_started or tutorials' reference files that do not exist in references/, references scripts/ and assets/ directories that are not present in the bundle, and the 'Use `view` to read specific reference files' instruction is ambiguous. Not a 4 because these phantom pointers are real navigation failures, not minor organization gaps. | 3 / 5 |
Total | 11 / 20 Passed |