CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-safety

Scan dependencies for known vulnerabilities and licenses.

Overall
score

61%

Overview
Eval results
Files

Evaluation results

0%

Package Manager Command Parser

Command Intention Normalization

Criteria
Without context
With context

Import Safety components

0%

0%

CommandToolIntention usage

0%

0%

Dependency extraction

0%

0%

Multi-tool support

0%

0%

Dev dependency detection

0%

0%

62%

62%

Vulnerability Report Formatter

Output Formatting

Criteria
Without context
With context

SafetyFormatter usage

0%

20%

JSON formatter implementation

0%

90%

Screen formatter implementation

0%

90%

Text formatter implementation

0%

86%

Output format selection

0%

80%

Vulnerability data models

0%

0%

100%

2%

Dependency Vulnerability Checker

Vulnerability Scanning

Criteria
Without context
With context

Safety CLI invocation

100%

100%

Requirements file processing

100%

100%

JSON output format

100%

100%

Vulnerability data extraction

100%

100%

Severity information

100%

100%

Error handling

80%

100%

66%

-23%

Security Scanner Integration Tool

Announcements & Notifications

Criteria
Without context
With context

Safety CLI Invocation

100%

80%

JSON Output Format

100%

33%

Announcement Extraction

60%

60%

Warning Categorization

90%

60%

Output Parsing

93%

80%

Error Handling

100%

100%

80%

17%

CI/CD Security Scanner Wrapper

CI/CD Integration

Criteria
Without context
With context

Uses safety scan command

80%

100%

JSON output format

100%

100%

Exit code handling

40%

100%

Non-blocking mode implementation

50%

50%

Target path specification

33%

33%

18%

-2%

Vulnerability Alert System

GitHub Integration - Automated PR & Issue Creation

Criteria
Without context
With context

Vulnerability Scanning

40%

40%

GitHub PR Creation

0%

0%

Remediation Application

0%

0%

Severity Filtering

33%

33%

GitHub Authentication

50%

30%

100%

90%

Python Environment Vulnerability Reporter

System-Wide Scanning

Criteria
Without context
With context

System-wide scanning

0%

100%

Targeted directory scanning

0%

100%

Output format handling

0%

100%

Subprocess execution

0%

100%

Report data extraction

100%

100%

100%

Package Manager Safety Wrapper

Firewall Mode - Package Manager Interception

Criteria
Without context
With context

Firewall initialization

100%

100%

Firewall removal

100%

100%

Tool specification

100%

100%

Command execution

100%

100%

Error detection

100%

100%

43%

13%

Security Scan Automation Tool

Authentication & Authorization

Criteria
Without context
With context

Auth Status Command

33%

50%

Status Data Retrieval

8%

0%

Authentication State Handling

50%

100%

CLI Integration

26%

33%

Error Handling

40%

30%

36%

11%

Security Policy Manager

Policy Management & Configuration System

Criteria
Without context
With context

Policy Generation

0%

0%

YAML Policy Structure

60%

75%

Policy Validation

0%

0%

Policy Loading

0%

33%

Ignore Rules Handling

60%

70%

CVSS Threshold Configuration

80%

100%

Error Handling

60%

80%

Install with Tessl CLI

npx tessl i tessl/pypi-safety
Evaluated
Agent
Claude Code

Table of Contents