CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-vedro

Pragmatic Testing Framework for Python with BDD-style syntax and pluggable architecture

49%

Overall

Evaluation49%

1.09x

Agent success when using this tile

Overview
Eval results
Files

task.mdevals/scenario-5/

Scenario Selection Suite

Build a minimal scenario suite and runner that demonstrates selective execution by path, subject content, tag expressions, and ordering controls. The suite should be easy to run with a few fixture scenarios that make the filters and ordering obvious.

Capabilities

Path and Subject Filtering

  • Running with paths limited to scenarios/payments executes only the payment scenario and omits unrelated subjects while still reporting discovery count. @test
  • Supplying a subject substring of "refund" executes only scenarios whose subjects include that substring, even across different files. @test

Tag Expressions and Skips

  • An include tag query of smoke&!slow executes only scenarios tagged with smoke but not slow, even when other scenarios live in the same file. @test
  • Scenarios marked as skipped are reported as skipped and never execute step logic; the rest of the suite still runs. @test

Focused Execution

  • When any scenario is marked as focus-only, only those focused scenarios execute, and non-focused ones are reported as ignored rather than run. @test

Ordering Controls

  • Supports declaration, reversed, and random ordering modes; random ordering repeats the same sequence when a fixed seed is provided. @test

Implementation

@generates

API

from typing import Iterable, Optional, Sequence
from dataclasses import dataclass

@dataclass
class ScenarioResult:
    subject: str
    status: str
    order_index: int

def run_suite(
    paths: Sequence[str],
    *,
    subject_substring: Optional[str] = None,
    include_tags: Optional[str] = None,
    exclude_tags: Optional[str] = None,
    focus_only: bool = False,
    order: str = "declaration",
    seed: Optional[int] = None,
) -> Iterable[ScenarioResult]:
    """Discover and execute scenarios under the given paths using selection controls and ordering."""

Dependencies { .dependencies }

vedro { .dependency }

Scenario-focused testing framework that provides selective execution, tag expressions, focus/skip markers, and ordering switches.

tessl i tessl/pypi-vedro@1.14.0

tile.json