tessl install tessl/pypi-gcloud@0.7.0Python client library for Google Cloud Platform services including Datastore, Storage, and Pub/Sub
Agent Success
Agent success rate when using this tile
93%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.19x
Baseline
Agent success rate without this tile
78%
{
"context": "This evaluation assesses the engineer's ability to use the gcloud Python package's Pub/Sub dead letter queue configuration feature. The focus is on proper usage of topic creation, subscription configuration with dead letter policies, message publishing, pulling, acknowledgment, and dead letter message handling.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Client Initialization",
"description": "Creates a pubsub.Client instance with the correct project_id parameter to establish connection to Google Cloud Pub/Sub service",
"max_score": 10
},
{
"name": "Topic Creation",
"description": "Uses client.topic() to create Topic instances for both the primary and dead letter topics, and calls the create() method on each topic to provision them in Pub/Sub",
"max_score": 15
},
{
"name": "Dead Letter Configuration",
"description": "Creates a Subscription instance using topic.subscription() and properly configures it with dead letter queue parameters, specifically setting the dead_letter_topic reference and max_delivery_attempts parameter to control when messages are moved to the dead letter topic",
"max_score": 25
},
{
"name": "Message Publishing",
"description": "Uses the topic.publish() method to send messages to the primary topic with appropriate message data",
"max_score": 10
},
{
"name": "Message Pulling",
"description": "Uses subscription.pull() method with appropriate parameters (like max_messages) to retrieve messages from both the primary and dead letter subscriptions",
"max_score": 15
},
{
"name": "Message Acknowledgment",
"description": "Properly uses subscription.acknowledge() method with the correct ack_id values to acknowledge successfully processed messages and prevent redelivery",
"max_score": 15
},
{
"name": "Dead Letter Subscription",
"description": "Creates a separate subscription on the dead letter topic using topic.subscription() and subscription.create() to enable monitoring and retrieval of failed messages",
"max_score": 10
}
]
}