or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/aioredis@2.0.x
tile.json

tessl/pypi-aioredis

tessl install tessl/pypi-aioredis@2.0.0

asyncio (PEP 3156) Redis support

Agent Success

Agent success rate when using this tile

98%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.01x

Baseline

Agent success rate without this tile

97%

rubric.jsonevals/scenario-1/

{
  "context": "This criteria evaluates how well the engineer uses aioredis set operations to implement a user tagging system. The focus is on correct usage of Redis set commands through the aioredis client API.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Set addition",
      "description": "Uses sadd() method to add tags to user sets. Should correctly handle multiple tags in a single call.",
      "max_score": 15
    },
    {
      "name": "Set removal",
      "description": "Uses srem() method to remove tags from user sets. Should correctly handle multiple tags in a single call.",
      "max_score": 15
    },
    {
      "name": "Set retrieval",
      "description": "Uses smembers() method to retrieve all tags for a user.",
      "max_score": 10
    },
    {
      "name": "Membership testing",
      "description": "Uses sismember() method to check if a specific tag exists in a user's set.",
      "max_score": 10
    },
    {
      "name": "Set cardinality",
      "description": "Uses scard() method to count the number of tags a user has.",
      "max_score": 10
    },
    {
      "name": "Set intersection",
      "description": "Uses sinter() method to find common tags between two users' tag sets.",
      "max_score": 10
    },
    {
      "name": "Set union",
      "description": "Uses sunion() method to combine tags from two users' tag sets.",
      "max_score": 10
    },
    {
      "name": "Set difference",
      "description": "Uses sdiff() method to find tags in one user's set but not in another's.",
      "max_score": 10
    },
    {
      "name": "Random member retrieval",
      "description": "Uses srandmember() method to get a random tag without removing it.",
      "max_score": 5
    },
    {
      "name": "Random member pop",
      "description": "Uses spop() method to remove and return a random tag.",
      "max_score": 5
    }
  ]
}