CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-syrupy

Pytest snapshot testing utility that enables developers to write tests asserting immutability of computed results.

Overall
score

80%

Overview
Eval results
Files

rubric.jsonevals/scenario-2/

{
  "context": "Evaluates how well the solution uses Syrupy in pytest to capture multiple snapshots in a single test. Focuses on exercising auto-indexed snapshots for sequential outputs and a custom-named snapshot for the filtered view while relying on Syrupy-managed storage.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Snapshot fixture",
      "description": "Uses the Syrupy snapshot fixture/assertion object in pytest to compare outputs instead of manual equality assertions.",
      "max_score": 20
    },
    {
      "name": "Auto indexing",
      "description": "Makes at least two sequential snapshot assertions in the same test without providing names so Syrupy auto-increments index-based snapshots for baseline and updated summaries.",
      "max_score": 25
    },
    {
      "name": "Custom name",
      "description": "Captures the filtered purchase view with a named snapshot via `snapshot(name=\"...\")` or `snapshot.assert_match(..., name=\"...\")` to create a labeled snapshot alongside indexed ones.",
      "max_score": 25
    },
    {
      "name": "Single-test grouping",
      "description": "Keeps baseline, updated summary, and the custom filtered snapshot within one pytest test function rather than splitting across tests to demonstrate multi-snapshot-per-test support.",
      "max_score": 15
    },
    {
      "name": "No manual storage",
      "description": "Relies on Syrupy-managed snapshot files (no manual file writes or custom numbering) so indexing and naming come directly from the library.",
      "max_score": 15
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-syrupy

tile.json