tessl install tessl/pypi-safety@3.6.0Scan dependencies for known vulnerabilities and licenses.
Agent Success
Agent success rate when using this tile
61%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.39x
Baseline
Agent success rate without this tile
44%
{
"context": "This criteria evaluates how well the engineer uses the Safety CLI package's authentication capabilities to check authentication status and handle different authentication states. The focus is on proper usage of Safety's auth commands and API for status checking.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Auth Status Command",
"description": "Uses Safety's `auth status` command or equivalent API (`safety.auth.main.status()` or `safety.auth.cli.status()`) to check authentication state",
"max_score": 30
},
{
"name": "Status Data Retrieval",
"description": "Properly retrieves and uses authentication data from Safety's API, such as `get_authorization_data()` or equivalent functions to obtain authentication information",
"max_score": 25
},
{
"name": "Authentication State Handling",
"description": "Correctly interprets and handles different authentication states (authenticated, not authenticated, error) returned by Safety's authentication system",
"max_score": 20
},
{
"name": "CLI Integration",
"description": "Properly integrates with Safety's CLI framework by using appropriate imports from `safety.cli`, `safety.auth.cli`, or `safety.auth.main` modules",
"max_score": 15
},
{
"name": "Error Handling",
"description": "Uses Safety's authentication exceptions or error handling patterns to manage authentication failures and provide appropriate feedback",
"max_score": 10
}
]
}