CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-syrupy

Pytest snapshot testing utility that enables developers to write tests asserting immutability of computed results.

Overall
score

80%

Overview
Eval results
Files

rubric.jsonevals/scenario-4/

{
  "context": "Evaluates whether the solution configures Syrupy's global defaults correctly, using the snapshot fixture to persist options and relying on CLI flags for extension, directory naming, and color handling. Scoring prioritizes correct use of Syrupy APIs and options rather than general test structure or style. The goal is to verify knowledge of how Syrupy's defaults and CLI hooks control snapshot storage and output.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Persisted defaults",
      "description": "Uses the Syrupy snapshot fixture's with_defaults (or equivalent API on SnapshotAssertion) to create a configured snapshot that retains matcher and exclude defaults instead of reapplying options per assertion.",
      "max_score": 25
    },
    {
      "name": "Matcher reuse",
      "description": "Applies the persisted snapshot variant for multiple assertions so the same matcher handles dynamic fields and exclusions across payloads without restating options, demonstrating reliance on Syrupy's preserved defaults.",
      "max_score": 20
    },
    {
      "name": "Default extension",
      "description": "Invokes Syrupy's CLI option --snapshot-default-extension (e.g., targeting syrupy.extensions.json.JSONSnapshotExtension) to make JSON the default snapshot format for the run, rather than hardcoding extension logic.",
      "max_score": 20
    },
    {
      "name": "Custom dirname",
      "description": "Configures the snapshot directory via Syrupy's --snapshot-dirname CLI flag so snapshots land under the requested snapshots_alt folder instead of relying on defaults or manual path building.",
      "max_score": 15
    },
    {
      "name": "Color toggle",
      "description": "Disables colored diff output using Syrupy's --snapshot-no-colors CLI option (or corresponding config/env) and ensures resulting diff text is ANSI-free when an assertion fails.",
      "max_score": 20
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-syrupy

tile.json