or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/pytest-redis@3.1.x
tile.json

tessl/pypi-pytest-redis

tessl install tessl/pypi-pytest-redis@3.1.0

Redis fixtures and fixture factories for Pytest.

Agent Success

Agent success rate when using this tile

95%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.12x

Baseline

Agent success rate without this tile

85%

rubric.jsonevals/scenario-6/

{
  "context": "This evaluation assesses how well the engineer uses pytest-redis's custom exception types (RedisUnsupported, RedisMisconfigured, UnixSocketTooLong) to implement proper error handling in Redis configuration validation functions.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "RedisMisconfigured usage",
      "description": "The validate_redis_executable function correctly imports and raises pytest_redis.exceptions.RedisMisconfigured (or pytest_redis.exception.RedisMisconfigured) when the executable path is invalid or inaccessible.",
      "max_score": 30
    },
    {
      "name": "UnixSocketTooLong usage",
      "description": "The validate_socket_path function correctly imports and raises pytest_redis.exceptions.UnixSocketTooLong (or pytest_redis.exception.UnixSocketTooLong) when the socket path exceeds platform-specific length limits.",
      "max_score": 30
    },
    {
      "name": "RedisUnsupported usage",
      "description": "The validate_redis_version function correctly imports and raises pytest_redis.exceptions.RedisUnsupported (or pytest_redis.exception.RedisUnsupported) when the Redis version is below the minimum required version.",
      "max_score": 30
    },
    {
      "name": "Exception import",
      "description": "All three custom exceptions are properly imported from the pytest_redis package (from pytest_redis.exception or pytest_redis.exceptions).",
      "max_score": 10
    }
  ]
}