tessl/pypi-vedro
Pragmatic Testing Framework for Python with BDD-style syntax and pluggable architecture
Evaluation results
25%
-75%Seeded Random Scenario Suite
deterministic seeding and @seed overrides with seed reporting
Run seed flag
100%
0%
Generated seed reuse
100%
0%
Scenario override
100%
100%
Override precedence
100%
0%
Seed reporting
100%
0%
11%
0%Delivery Quote Validation
@params parameterization for templated scenarios
Stacked params
0%
0%
Keyword params
0%
0%
Decorator piping
0%
0%
Single template
33%
33%
Param value flow
60%
60%
40%
-5%Checkout Journeys Suite
scenario-based testing DSL (classes or @scenario with given/when/then steps)
Class scenario
40%
32%
Decorator scenario
0%
0%
Retry logging
87%
40%
Out-of-stock flow
40%
40%
State sharing
100%
80%
Event tracking
40%
80%
40%
-2%Built-in Reporter Capture Harness
built-in reporters with output capture options
Dual reporters
33%
33%
Rich reporter
100%
100%
JSON reporter path
0%
0%
Capture toggle
33%
47%
Capture limit
80%
53%
31%
16%Scenario Selection Suite
scenario selection controls (paths, subjects, tags, @only/@skip) and ordering
Path filter
0%
25%
Subject filter
0%
33%
Tag expressions
0%
20%
Focus and skip
50%
40%
Ordering and seed
25%
40%
43%
13%Signal-Aware Suite Runner
interruption and exit handling (fail-fast, signals, terminator exit codes)
Interrupter hook
50%
25%
Fail-fast threshold
20%
40%
Signal stop
25%
0%
Terminator exit codes
25%
75%
Allow-empty switch
33%
87%
100%
40%Config-Aware Scenario Runner
CLI runner with vedro.cfg.py config loading and plugin registry
vedro run
100%
100%
Config loading
75%
100%
Plugin wiring
50%
100%
Enable/disable
0%
100%
Registry listing
67%
100%
53%
3%Plugin bootstrapper with validated plugin configs
plugin management commands and computed config validation
Plugin install
50%
50%
Plugin listing
100%
80%
Computed options
0%
30%
Validation flag
100%
100%
Rejects unknown
0%
0%
75%
50%Sliced Suite Runner
slicing and sharding test runs across workers with ordering tweaks
Vedro entrypoint
100%
100%
Slice forwarding
0%
100%
Ordering modes
0%
25%
Random seed
0%
50%
Arg passthrough
0%
100%
70%
0%Ephemeral Resource Cleanup Workflow
deferred cleanup queues plus temp dir/file helpers
Temp dir helper
100%
100%
Scenario defers
100%
100%
Temp file helper
0%
0%
Global defer
100%
100%
Cleanup order
33%
33%
tessl i tessl/pypi-vedro@1.14.0Evaluated
Agent
Codex
Table of Contents