CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-crosshair-tool

Analyze Python code for correctness using symbolic execution and SMT solving to automatically find counterexamples for functions with type annotations and contracts.

86

1.24x
Overview
Eval results
Files

Evaluation results

100%

Generic Type Utilities

Dynamic typing support with TypeVar binding

Criteria
Without context
With context

TypeVar declaration

100%

100%

Generic tuple typing

100%

100%

PEP316 preconditions

100%

100%

PEP316 postconditions

100%

100%

Bounded TypeVar usage

100%

100%

Generic List typing

100%

100%

Contract verification

100%

100%

92%

2%

Symbolic Value Generator

Symbolic type system with proxy creation for Python types

Criteria
Without context
With context

Uses proxy_for_type

100%

83%

Correct type handling

80%

100%

Uses realize function

75%

85%

Proper error handling

100%

100%

Symbolic value integration

100%

100%

100%

76%

Bank Account Manager

Contract checking and verification with multiple syntax support

Criteria
Without context
With context

Preconditions for inputs

20%

100%

Postconditions for state

20%

100%

Class invariants

20%

100%

Old value tracking

53%

100%

Contract syntax variety

13%

100%

100%

User Account Manager

Runtime contract enforcement with decorators

Criteria
Without context
With context

Contract decorator usage

100%

100%

Runtime enforcement

100%

100%

Precondition validation

100%

100%

Postcondition validation

100%

100%

Exception handling

100%

100%

100%

100%

Function Behavior Comparator

Behavioral difference detection (diffbehavior) between implementations

Criteria
Without context
With context

Import diff_behavior

0%

100%

Call diff_behavior

0%

100%

Iterate over results

0%

100%

Extract input arguments

0%

100%

Configure analysis options

0%

100%

30%

Contract Monitoring Service

File watching and continuous analysis

Criteria
Without context
With context

Uses watch command

0%

0%

Integrates contract checking

0%

0%

Handles watch results

0%

0%

Implements graceful shutdown

100%

100%

Structured output format

100%

100%

73%

-5%

Custom Type Plugin for Contract Verification

Plugin system for custom types and contracts

Criteria
Without context
With context

register_type usage

100%

100%

Symbolic value creator

40%

25%

Constraint application

33%

20%

register_contract usage

100%

100%

Precondition specification

100%

100%

Postcondition specification

100%

100%

63%

-7%

Configuration Validator

Search and optimization for constraint solving

Criteria
Without context
With context

Symbolic value creation

80%

40%

Constraint implementation

100%

100%

Search command usage

40%

12%

Optimization strategy

60%

100%

Integration completeness

80%

100%

100%

Date Range Validator

Symbolic standard library implementations (64+ modules)

Criteria
Without context
With context

PEP316 Contract Syntax

100%

100%

Datetime Type Usage

100%

100%

Precondition Implementation

100%

100%

Postcondition Implementation

100%

100%

Date Arithmetic Operations

100%

100%

100%

Test Suite Generator

Test generation (cover) with automatic pytest output

Criteria
Without context
With context

Uses crosshair cover

100%

100%

Pytest format output

100%

100%

Writes output file

100%

100%

Handles module path

100%

100%

Returns success status

100%

100%

Install with Tessl CLI

npx tessl i tessl/pypi-crosshair-tool
Evaluated
Agent
Claude Code

Table of Contents