Integrate PostHog into any python application.
89
Pending
Does it follow best practices?
Impact
89%
1.03xAverage score across 10 eval scenarios
Pending
The risk profile of this skill
{
"context": "This evaluation assesses how well the engineer uses the PostHog Python SDK to implement an analytics tracker with robust network retry logic and exponential backoff. The focus is on proper client initialization with retry configuration, event capture, and graceful shutdown handling.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Client initialization",
"description": "Uses posthog.Client() or calls posthog.init() to initialize the PostHog client with the api_key parameter (project_api_key) and host parameter.",
"max_score": 15
},
{
"name": "Retry configuration",
"description": "Configures max_retries parameter when initializing the PostHog client to control the number of retry attempts for failed network requests.",
"max_score": 25
},
{
"name": "Timeout configuration",
"description": "Configures timeout parameter when initializing the PostHog client to set the HTTP request timeout duration.",
"max_score": 20
},
{
"name": "Event capture",
"description": "Uses posthog.capture() method to track events with event name (event parameter), user identifier (distinct_id parameter), and custom properties (properties parameter).",
"max_score": 20
},
{
"name": "Graceful shutdown",
"description": "Calls posthog.shutdown() or calls both posthog.flush() and posthog.join() to ensure all pending events are sent before the application exits.",
"max_score": 20
}
]
}docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10