CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-syrupy

Pytest snapshot testing utility that enables developers to write tests asserting immutability of computed results.

Overall
score

80%

Overview
Eval results
Files

Evaluation results

75%

45%

Snapshot Regeneration Guard

Strict matcher/tainted snapshot error handling for regeneration workflows

Criteria
Without context
With context

Snapshot fixture

100%

100%

Strict matcher

0%

100%

Type error check

0%

66%

Tainted detection

0%

25%

Regeneration update

50%

75%

100%

Multi-stage Event Snapshots

Multiple snapshots per test with auto indexing and custom names

Criteria
Without context
With context

Snapshot fixture

100%

100%

Auto indexing

100%

100%

Custom name

100%

100%

Single-test grouping

100%

100%

No manual storage

100%

100%

100%

Snapshot-Driven Sensor Report

Pytest snapshot fixture equality with update flag

Criteria
Without context
With context

Snapshot assertions

100%

100%

Scenario snapshots

100%

100%

Snapshot files

100%

100%

Update flag ready

100%

100%

55%

35%

Snapshot Defaults Harness

Global defaults via with_defaults and CLI options for default extension/dirname/colors

Criteria
Without context
With context

Persisted defaults

0%

100%

Matcher reuse

100%

100%

Default extension

0%

25%

Custom dirname

0%

0%

Color toggle

0%

25%

100%

5%

Snapshot Discovery Runner

Snapshot discovery controls for ignore file extensions and custom dirname

Criteria
Without context
With context

Uses plugin

75%

100%

Custom dirname

100%

100%

Ignore extensions

100%

100%

Update support

100%

100%

40%

5%

Snapshot Diff Sprint Report

Diff-based assertions comparing against prior snapshot index or name

Criteria
Without context
With context

Baseline snapshot

100%

100%

Index diff

0%

0%

Named baseline

0%

16%

Snapshot sequencing

100%

100%

80%

16%

Snapshot Hygiene Check

Unused snapshot detection with removal or warn/reporting modes

Criteria
Without context
With context

Snapshot fixture

100%

100%

Strict unused failure

72%

80%

Cleanup on update

60%

100%

Warn mode reporting

80%

100%

Detailed output

0%

0%

60%

55%

Snapshot Output Controls

IDE and output controls including PyCharm diff patch and color toggles

Criteria
Without context
With context

PyCharm patch flag

0%

16%

Fixture-driven patch

0%

40%

Color disabling

0%

90%

Colorful diff

0%

93%

Snapshot assertions

33%

100%

90%

28%

Snapshot-Ready Telemetry Summaries

Per-assert configuration for matchers, filters, and extension selection

Criteria
Without context
With context

Matcher usage

33%

83%

Path filters

48%

80%

Extension choice

100%

100%

Scoped config

100%

100%

Coverage asserts

50%

100%

100%

Snapshot Format Sampler

Built-in extensions for Amber, JSON, raw, PNG, and SVG outputs

Criteria
Without context
With context

Amber default

100%

100%

JSON extension

100%

100%

Raw bytes

100%

100%

PNG snapshot

100%

100%

SVG snapshot

100%

100%

Install with Tessl CLI

npx tessl i tessl/pypi-syrupy
Evaluated
Agent
Claude Code

Table of Contents