or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/pytest-redis@3.1.x
tile.json

tessl/pypi-pytest-redis

tessl install tessl/pypi-pytest-redis@3.1.0

Redis fixtures and fixture factories for Pytest.

Agent Success

Agent success rate when using this tile

95%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.12x

Baseline

Agent success rate without this tile

85%

rubric.jsonevals/scenario-8/

{
  "context": "This criteria evaluates how well the engineer uses pytest-redis's flexible port allocation strategies to create multiple independent Redis instances with different port configuration approaches. The focus is on proper usage of the factories.redis_proc() factory function with various port parameter options.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Random port allocation",
      "description": "Uses factories.redis_proc(port=None) to create a Redis process fixture that allocates a random available port",
      "max_score": 20
    },
    {
      "name": "Port range allocation",
      "description": "Uses factories.redis_proc(port=(min, max)) with a tuple to create a Redis process fixture that allocates a port within the specified range",
      "max_score": 20
    },
    {
      "name": "Port set allocation",
      "description": "Uses factories.redis_proc(port={port1, port2, ...}) with a set to create a Redis process fixture that allocates from specific ports",
      "max_score": 20
    },
    {
      "name": "Client fixture creation",
      "description": "Uses factories.redisdb() to create Redis client fixtures that connect to the custom process fixtures, correctly passing the process fixture name as a string parameter",
      "max_score": 20
    },
    {
      "name": "Multiple instances verification",
      "description": "Demonstrates that multiple Redis instances with different port allocation strategies can run simultaneously by using multiple client fixtures in the same test function",
      "max_score": 15
    },
    {
      "name": "Test implementation correctness",
      "description": "Tests verify that Redis instances are working correctly (e.g., by setting and getting values, checking connection info) and confirm isolation between instances",
      "max_score": 5
    }
  ]
}