tessl install tessl/pypi-pytest-redis@3.1.0Redis fixtures and fixture factories for Pytest.
Agent Success
Agent success rate when using this tile
95%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.12x
Baseline
Agent success rate without this tile
85%
{
"context": "This evaluation assesses how well the engineer uses pytest-redis to configure and test Redis authentication. The focus is on correctly using pytest-redis factory functions to create authenticated Redis fixtures and validating authentication behavior.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Factory Function Usage",
"description": "Uses factories.redis_proc() to create a custom Redis process fixture with username and password parameters configured (e.g., username='cacheuser', password='securepass123')",
"max_score": 30
},
{
"name": "Client Factory Usage",
"description": "Uses factories.redisdb() to create a custom Redis client fixture that connects to the authenticated Redis process fixture",
"max_score": 25
},
{
"name": "Authenticated Connection Test",
"description": "Implements a test that uses the authenticated Redis client fixture to perform set and get operations successfully (sets 'user:1' to 'Alice' and verifies retrieval)",
"max_score": 25
},
{
"name": "Authentication Failure Test",
"description": "Implements a test that attempts to connect to the authenticated Redis instance without credentials and verifies that an authentication error occurs",
"max_score": 20
}
]
}