CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-syrupy

Pytest snapshot testing utility that enables developers to write tests asserting immutability of computed results.

Overall
score

80%

Overview
Eval results
Files

rubric.jsonevals/scenario-6/

{
  "context": "Evaluates how well the solution leverages syrupy's diff-based snapshot assertions to validate sequential sprint summaries. The focus is on capturing a baseline, then comparing later outputs against that baseline by index or custom name to store diffs rather than full snapshots. Criteria ignore general coding style and look only at syrupy-specific usage in the tests.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Baseline snapshot",
      "description": "Uses the syrupy pytest `snapshot` fixture to record the initial sprint summary as the first snapshot before any diff assertions.",
      "max_score": 20
    },
    {
      "name": "Index diff",
      "description": "Compares a subsequent sprint summary using `snapshot(diff=<index>)` (e.g., `diff=1`) to reference the earlier baseline snapshot by index, ensuring the diff-based assertion aligns with the spec's index-based change check.",
      "max_score": 35
    },
    {
      "name": "Named baseline",
      "description": "Creates a custom-named snapshot via `snapshot(name=\"<label>\")` for the release-candidate baseline and later asserts the modified summary using `snapshot(diff=\"<label>\")` to target that named snapshot.",
      "max_score": 30
    },
    {
      "name": "Snapshot sequencing",
      "description": "Keeps assertions in a single test or coordinated tests so that snapshot numbering/naming is stable, allowing the diff references to resolve correctly when rerun (no stray snapshot fixture calls that would shift indexes).",
      "max_score": 15
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-syrupy

tile.json