CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-allure-python-commons

Contains the API for end users as well as helper functions and classes to build Allure adapters for Python test frameworks

Overall
score

94%

Overview
Eval results
Files

rubric.jsonevals/scenario-5/

{
  "context": "This criteria evaluates how effectively the engineer uses allure-python-commons' step tracking functionality to create detailed, hierarchical test reporting. The focus is on proper usage of allure.step() as both a decorator and context manager, parameter interpolation in step titles, and creating meaningful step hierarchies.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Step Context Manager",
      "description": "Uses allure.step() as a context manager with the 'with' statement to define test steps within test functions",
      "max_score": 20
    },
    {
      "name": "Step Decorator",
      "description": "Uses @allure.step() decorator on helper functions to automatically create steps when those functions are called",
      "max_score": 20
    },
    {
      "name": "Parameter Interpolation",
      "description": "Includes dynamic parameters in step titles using string formatting/interpolation (e.g., 'Add {product_name} to cart') to make steps more descriptive",
      "max_score": 20
    },
    {
      "name": "Nested Steps",
      "description": "Creates hierarchical step structures by nesting steps within other steps, demonstrating that steps can contain sub-steps",
      "max_score": 20
    },
    {
      "name": "Step Coverage",
      "description": "All three test scenarios (successful order flow, failed payment handling, multi-item cart operations) are implemented with appropriate step tracking throughout the test execution",
      "max_score": 15
    },
    {
      "name": "Meaningful Step Titles",
      "description": "Step titles clearly describe the action being performed and are written in a way that would be useful in a test report (e.g., 'Process payment of $1200' rather than just 'Process payment')",
      "max_score": 5
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-allure-python-commons

tile.json