Maintains a persistent, interlinked markdown wiki between immutable raw sources and answers: ingest, query, lint, index and log—compounding knowledge instead of one-shot RAG.
94
94%
Does it follow best practices?
Impact
96%
0.97xAverage score across 3 eval scenarios
Passed
No known issues
{
"context": "Tests whether the agent reads the wiki schema (AGENTS.md) before creating any files, uses schema-defined paths for all outputs, and does not invent paths or directory structures that contradict the configuration. Also tests that raw sources remain unmodified and that the log entry uses the correct format.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Schema-defined wiki root used",
"description": "All wiki pages created are located under `notes/wiki/` (the wiki root defined in AGENTS.md), not under an invented path like `wiki/`, `knowledge/`, or any other top-level directory.",
"max_score": 12
},
{
"name": "Schema-defined topic path used",
"description": "New topic page(s) are created inside `notes/wiki/topics/` as specified in AGENTS.md, not at another location such as `notes/wiki/articles/` or `notes/wiki/pages/`.",
"max_score": 12
},
{
"name": "Schema-defined index path used",
"description": "The index is updated at `notes/wiki/index.md` (matching AGENTS.md), not at a differently named or differently located index file.",
"max_score": 10
},
{
"name": "Schema-defined log path used",
"description": "The log entry is appended to `notes/wiki/log.md` (matching AGENTS.md), not to a differently named or differently located log file.",
"max_score": 10
},
{
"name": "Topic filename naming convention",
"description": "New topic page filenames are lowercase and hyphen-separated (e.g. `attention-mechanisms.md`), matching the naming convention in AGENTS.md—not CamelCase, underscored, or otherwise formatted.",
"max_score": 8
},
{
"name": "Index categories respected",
"description": "The updated `notes/wiki/index.md` uses the section headings `## Topics`, `## People`, and/or `## Sources` as defined in AGENTS.md—not custom categories invented by the agent.",
"max_score": 8
},
{
"name": "Raw source unmodified",
"description": "The content of `notes/raw/2026-03-15-attention-mechanisms.md` is identical to the provided input—no edits, additions, or deletions have been made to it.",
"max_score": 10
},
{
"name": "Log entry keyword correct",
"description": "The log entry heading in `notes/wiki/log.md` uses the word `ingest` as the operation keyword, not a synonym like `add`, `update`, `import`, or `process`.",
"max_score": 10
},
{
"name": "Log entry format correct",
"description": "The log entry heading matches the pattern `## [YYYY-MM-DD] ingest | <short title>` with bracket-wrapped ISO date and pipe separator, as shown in AGENTS.md.",
"max_score": 10
},
{
"name": "No invented top-level directories",
"description": "The agent does NOT create directories that contradict or extend the schema without basis (e.g., no `notes/wiki/summaries/`, `notes/wiki/entities/`, or `sources/` at the workspace root if not in the schema).",
"max_score": 10
}
]
}