or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/allure-python-commons@2.15.x
tile.json

tessl/pypi-allure-python-commons

tessl install tessl/pypi-allure-python-commons@2.15.0

Contains the API for end users as well as helper functions and classes to build Allure adapters for Python test frameworks

Agent Success

Agent success rate when using this tile

94%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.27x

Baseline

Agent success rate without this tile

74%

rubric.jsonevals/scenario-7/

{
  "context": "This criteria evaluates how effectively the engineer uses allure-python-commons fixture lifecycle management APIs to track setup and teardown operations. The focus is on proper usage of lifecycle methods, fixture tracking, and status management.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "AllureLifecycle instantiation",
      "description": "Creates or imports an instance of AllureLifecycle from allure_commons.lifecycle to manage fixture lifecycle",
      "max_score": 10
    },
    {
      "name": "start_before_fixture usage",
      "description": "Correctly uses lifecycle.start_before_fixture() or lifecycle.schedule_before_fixture() to begin tracking setup fixtures with proper parent_uuid parameter",
      "max_score": 20
    },
    {
      "name": "start_after_fixture usage",
      "description": "Correctly uses lifecycle.start_after_fixture() or lifecycle.schedule_after_fixture() to begin tracking teardown fixtures with proper parent_uuid parameter",
      "max_score": 20
    },
    {
      "name": "Fixture UUID management",
      "description": "Properly generates and manages unique UUIDs for fixtures using uuid4() or similar, and returns them from start methods",
      "max_score": 10
    },
    {
      "name": "stop_before_fixture usage",
      "description": "Correctly uses lifecycle.stop_before_fixture() to complete tracking of setup fixtures with the appropriate UUID",
      "max_score": 10
    },
    {
      "name": "stop_after_fixture usage",
      "description": "Correctly uses lifecycle.stop_after_fixture() to complete tracking of teardown fixtures with the appropriate UUID",
      "max_score": 10
    },
    {
      "name": "Fixture status tracking",
      "description": "Updates fixture status using update_before_fixture() or update_after_fixture() or by setting the status property on fixture results (Status.PASSED, Status.FAILED, Status.BROKEN)",
      "max_score": 10
    },
    {
      "name": "Timing capture",
      "description": "Captures fixture execution timing using start/stop timestamps, leveraging lifecycle timing or manual calculation to provide duration_ms",
      "max_score": 5
    },
    {
      "name": "Fixture data retrieval",
      "description": "Retrieves fixture results from the lifecycle using appropriate methods or internal data structures to generate the report",
      "max_score": 5
    }
  ]
}