Maintains a persistent, interlinked markdown wiki between immutable raw sources and answers: ingest, query, lint, index and log—compounding knowledge instead of one-shot RAG.
94
94%
Does it follow best practices?
Impact
96%
0.97xAverage score across 3 eval scenarios
Passed
No known issues
{
"context": "Tests whether the agent ingests a source containing image references by storing images locally under the wiki assets folder and using relative paths in wiki pages, integrates into multiple wiki pages, adds cross-links, and correctly updates the index and log.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Images stored under wiki/assets/",
"description": "Both image files (cnn-pipeline.png and residual-block.png) are copied or present under `wiki/assets/` — not referenced at their original raw path (`images/`) or via any external URL.",
"max_score": 15
},
{
"name": "Wiki pages use relative image paths",
"description": "Wiki page(s) that reference the images do so using relative paths pointing into `wiki/assets/` (e.g. `../assets/cnn-pipeline.png` or `assets/cnn-pipeline.png`), not the original `../images/` raw path.",
"max_score": 12
},
{
"name": "Multiple wiki pages created or updated",
"description": "At least two distinct wiki pages under `wiki/topics/` are created or updated — for example, pages covering convolutional networks and residual connections, or updates to existing pages on gradient descent or backpropagation.",
"max_score": 10
},
{
"name": "Cross-links to existing pages",
"description": "At least one newly created or updated wiki page links to an existing wiki page (e.g. gradient-descent.md or backpropagation.md), and at least one existing page is updated to add a 'See also' or equivalent link back to the new content.",
"max_score": 10
},
{
"name": "Raw source unmodified",
"description": "The content of `raw/2026-04-06-cnn-architectures.md` is not modified — no edits, additions, or deletions to its text.",
"max_score": 10
},
{
"name": "Index updated with new pages",
"description": "`wiki/index.md` is updated to include links and one-line descriptions for every new wiki page created during this ingest.",
"max_score": 10
},
{
"name": "Log entry appended (not overwritten)",
"description": "The existing log entry `## [2026-01-10] ingest | gradient-descent-overview` is still present and unmodified in `wiki/log.md`, and a new entry has been appended after it.",
"max_score": 10
},
{
"name": "Log entry format correct",
"description": "The new log entry heading matches the pattern `## [YYYY-MM-DD] ingest | <short title>` with bracket-wrapped ISO date and pipe separator.",
"max_score": 10
},
{
"name": "Log body lists touched files",
"description": "The new log entry body includes bullet points listing the wiki paths that were created or changed, including the new topic page(s) and the assets copied.",
"max_score": 8
},
{
"name": "People pages created if schema supports",
"description": "If a people or person directory exists or is implied, at least one people page is created for a key researcher mentioned in the source (e.g. Yann LeCun or Kaiming He), OR an existing people section is updated.",
"max_score": 5
}
]
}