or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/pytest-redis@3.1.x
tile.json

tessl/pypi-pytest-redis

tessl install tessl/pypi-pytest-redis@3.1.0

Redis fixtures and fixture factories for Pytest.

Agent Success

Agent success rate when using this tile

95%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.12x

Baseline

Agent success rate without this tile

85%

rubric.jsonevals/scenario-2/

{
  "context": "This evaluation assesses how well the engineer uses pytest-redis to configure and test Redis authentication. The focus is on correctly using pytest-redis factory functions to create authenticated Redis fixtures and validating authentication behavior.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Factory Function Usage",
      "description": "Uses factories.redis_proc() to create a custom Redis process fixture with username and password parameters configured (e.g., username='cacheuser', password='securepass123')",
      "max_score": 30
    },
    {
      "name": "Client Factory Usage",
      "description": "Uses factories.redisdb() to create a custom Redis client fixture that connects to the authenticated Redis process fixture",
      "max_score": 25
    },
    {
      "name": "Authenticated Connection Test",
      "description": "Implements a test that uses the authenticated Redis client fixture to perform set and get operations successfully (sets 'user:1' to 'Alice' and verifies retrieval)",
      "max_score": 25
    },
    {
      "name": "Authentication Failure Test",
      "description": "Implements a test that attempts to connect to the authenticated Redis instance without credentials and verifies that an authentication error occurs",
      "max_score": 20
    }
  ]
}