Compiles and maintains a persistent LLM-written markdown wiki between immutable raw sources and answers—the Karpathy LLM Knowledge Base pattern. The agent writes and maintains the wiki; the human curates sources and reads it. Knowledge compounds instead of being re-derived each query. Triggers: llm wiki, persistent wiki, personal knowledge base, wiki maintenance, ingest sources, compound knowledge, index.md, log.md, Obsidian wiki, cross-references, Karpathy wiki pattern, compile wiki, knowledge base. Uses: Read, Glob, Grep, file edits, optional WebSearch, AskUserQuestion when schema or goals are ambiguous. Outputs: updated wiki pages, index, append-only log, citations on query, filed answers, visual outputs. Do NOT use for: mutating raw sources, one-off chat answers with no wiki artifact, or replacing a user-defined wiki schema without reading it first.
91
88%
Does it follow best practices?
Impact
96%
0.97xAverage score across 3 eval scenarios
Passed
No known issues
Quality
Discovery
100%Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.
This is a strong, well-crafted skill description that excels across all dimensions. It provides specific concrete actions, comprehensive trigger terms, clear what/when guidance including negative triggers, and occupies a highly distinctive niche. The description is detailed without being padded, and uses appropriate third-person voice throughout.
| Dimension | Reasoning | Score |
|---|---|---|
Specificity | Lists multiple specific concrete actions: 'compiles and maintains a persistent LLM-written markdown wiki', 'writes and maintains the wiki', 'ingest sources', 'updated wiki pages, index, append-only log, citations on query, filed answers, visual outputs'. Also specifies tools used and negative constraints. | 3 / 3 |
Completeness | Clearly answers both 'what' (compiles and maintains a persistent markdown wiki between raw sources and answers, outputs wiki pages/index/log/citations) and 'when' (explicit Triggers list plus 'Do NOT use for' negative triggers). The trigger guidance is explicit and comprehensive. | 3 / 3 |
Trigger Term Quality | Includes an explicit and extensive list of natural trigger terms: 'llm wiki', 'persistent wiki', 'personal knowledge base', 'wiki maintenance', 'ingest sources', 'compound knowledge', 'index.md', 'log.md', 'Obsidian wiki', 'cross-references', 'Karpathy wiki pattern', 'compile wiki', 'knowledge base'. These cover many natural variations a user might say. | 3 / 3 |
Distinctiveness Conflict Risk | Highly distinctive with a clear niche: the 'Karpathy LLM Knowledge Base pattern' is a very specific concept. The combination of persistent wiki maintenance, append-only logs, source ingestion, and the explicit 'Do NOT use for' clause makes it very unlikely to conflict with generic document or knowledge management skills. | 3 / 3 |
Total | 12 / 12 Passed |
Implementation
77%Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
This is a strong, well-designed skill that provides clear, actionable workflows for building and maintaining a persistent wiki. Its main strengths are the precise process definitions, strict constraints (immutable sources, exact log keywords), and thorough worked examples. The primary weakness is moderate verbosity—the content could be tightened by ~20-30% without losing clarity, and the referenced companion files are not available for verification.
Suggestions
Trim the integrated examples to one combined example that demonstrates ingest + query in fewer lines, or move the second example to a companion file.
Condense the scaling and anti-patterns sections—several anti-patterns restate the non-negotiables in negative form.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The skill is well-structured but somewhat verbose for an agent audience. The three-layer table, the scaling section, and the anti-patterns section add useful context but could be tightened. The integrated examples are valuable but lengthy—two full worked examples with step-by-step narration consume significant tokens. Some explanatory prose (e.g., 'so knowledge compounds rather than being rediscovered on every query') restates what Claude can infer. | 2 / 3 |
Actionability | The skill provides highly concrete, step-by-step processes for all three operations (ingest, query, lint) with specific file paths, exact log heading formats, and two detailed worked examples showing precise agent actions. The log format is copy-paste ready with exact keyword constraints and date formatting. The non-negotiables are specific and enforceable. | 3 / 3 |
Workflow Clarity | All three workflows (ingest, query, lint) are clearly sequenced with numbered steps. Validation is embedded: read schema first, read index before topic pages, flag contradictions explicitly, and the lint process serves as a dedicated validation/repair workflow. The query workflow has an explicit 'file the answer' step ensuring durable output. Error recovery is addressed (step 7 of ingest: wait for user direction if discussion needed). | 3 / 3 |
Progressive Disclosure | The skill references companion files (./rules/index-log-conventions.md, ./rules/optional-tooling.md) for detail, which is good progressive disclosure design. However, no bundle files were provided, so we cannot verify these references resolve. The main file itself is quite long (~180 lines) and some content (the full integrated examples, scaling section) could arguably be split out. The references are clearly signaled and one-level deep, which is positive. | 2 / 3 |
Total | 10 / 12 Passed |
Validation
100%Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.
Validation — 11 / 11 Passed
Validation for skill structure
No warnings or errors.
a283f77
Table of Contents
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.