or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/allure-python-commons@2.15.x
tile.json

tessl/pypi-allure-python-commons

tessl install tessl/pypi-allure-python-commons@2.15.0

Contains the API for end users as well as helper functions and classes to build Allure adapters for Python test frameworks

Agent Success

Agent success rate when using this tile

94%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.27x

Baseline

Agent success rate without this tile

74%

rubric.jsonevals/scenario-6/

{
  "context": "This criteria evaluates how effectively the engineer uses allure-python-commons' step tracking functionality to create detailed, hierarchical test reporting. The focus is on proper usage of allure.step() as both a decorator and context manager, parameter interpolation in step titles, and creating meaningful step hierarchies.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Step Context Manager",
      "description": "Uses allure.step() as a context manager with the 'with' statement to define test steps within test functions",
      "max_score": 20
    },
    {
      "name": "Step Decorator",
      "description": "Uses @allure.step() decorator on helper functions to automatically create steps when those functions are called",
      "max_score": 20
    },
    {
      "name": "Parameter Interpolation",
      "description": "Includes dynamic parameters in step titles using string formatting/interpolation (e.g., 'Add {product_name} to cart') to make steps more descriptive",
      "max_score": 20
    },
    {
      "name": "Nested Steps",
      "description": "Creates hierarchical step structures by nesting steps within other steps, demonstrating that steps can contain sub-steps",
      "max_score": 20
    },
    {
      "name": "Step Coverage",
      "description": "All three test scenarios (successful order flow, failed payment handling, multi-item cart operations) are implemented with appropriate step tracking throughout the test execution",
      "max_score": 15
    },
    {
      "name": "Meaningful Step Titles",
      "description": "Step titles clearly describe the action being performed and are written in a way that would be useful in a test report (e.g., 'Process payment of $1200' rather than just 'Process payment')",
      "max_score": 5
    }
  ]
}