Pytest snapshot testing utility that enables developers to write tests asserting immutability of computed results.
Overall
score
80%
{
"context": "Evaluates how well the solution leverages syrupy's diff-based snapshot assertions to validate sequential sprint summaries. The focus is on capturing a baseline, then comparing later outputs against that baseline by index or custom name to store diffs rather than full snapshots. Criteria ignore general coding style and look only at syrupy-specific usage in the tests.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Baseline snapshot",
"description": "Uses the syrupy pytest `snapshot` fixture to record the initial sprint summary as the first snapshot before any diff assertions.",
"max_score": 20
},
{
"name": "Index diff",
"description": "Compares a subsequent sprint summary using `snapshot(diff=<index>)` (e.g., `diff=1`) to reference the earlier baseline snapshot by index, ensuring the diff-based assertion aligns with the spec's index-based change check.",
"max_score": 35
},
{
"name": "Named baseline",
"description": "Creates a custom-named snapshot via `snapshot(name=\"<label>\")` for the release-candidate baseline and later asserts the modified summary using `snapshot(diff=\"<label>\")` to target that named snapshot.",
"max_score": 30
},
{
"name": "Snapshot sequencing",
"description": "Keeps assertions in a single test or coordinated tests so that snapshot numbering/naming is stable, allowing the diff references to resolve correctly when rerun (no stray snapshot fixture calls that would shift indexes).",
"max_score": 15
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-syrupyevals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10