CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-safety

Scan dependencies for known vulnerabilities and licenses.

Overall
score

61%

Overview
Eval results
Files

rubric.jsonevals/scenario-9/

{
  "context": "This criteria evaluates how well the engineer uses the Safety CLI package's authentication capabilities to check authentication status and handle different authentication states. The focus is on proper usage of Safety's auth commands and API for status checking.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Auth Status Command",
      "description": "Uses Safety's `auth status` command or equivalent API (`safety.auth.main.status()` or `safety.auth.cli.status()`) to check authentication state",
      "max_score": 30
    },
    {
      "name": "Status Data Retrieval",
      "description": "Properly retrieves and uses authentication data from Safety's API, such as `get_authorization_data()` or equivalent functions to obtain authentication information",
      "max_score": 25
    },
    {
      "name": "Authentication State Handling",
      "description": "Correctly interprets and handles different authentication states (authenticated, not authenticated, error) returned by Safety's authentication system",
      "max_score": 20
    },
    {
      "name": "CLI Integration",
      "description": "Properly integrates with Safety's CLI framework by using appropriate imports from `safety.cli`, `safety.auth.cli`, or `safety.auth.main` modules",
      "max_score": 15
    },
    {
      "name": "Error Handling",
      "description": "Uses Safety's authentication exceptions or error handling patterns to manage authentication failures and provide appropriate feedback",
      "max_score": 10
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-safety

tile.json