CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-allure-python-commons

Contains the API for end users as well as helper functions and classes to build Allure adapters for Python test frameworks

Overall
score

94%

Overview
Eval results
Files

rubric.jsonevals/scenario-6/

{
  "context": "This criteria evaluates how effectively the engineer uses allure-python-commons fixture lifecycle management APIs to track setup and teardown operations. The focus is on proper usage of lifecycle methods, fixture tracking, and status management.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "AllureLifecycle instantiation",
      "description": "Creates or imports an instance of AllureLifecycle from allure_commons.lifecycle to manage fixture lifecycle",
      "max_score": 10
    },
    {
      "name": "start_before_fixture usage",
      "description": "Correctly uses lifecycle.start_before_fixture() or lifecycle.schedule_before_fixture() to begin tracking setup fixtures with proper parent_uuid parameter",
      "max_score": 20
    },
    {
      "name": "start_after_fixture usage",
      "description": "Correctly uses lifecycle.start_after_fixture() or lifecycle.schedule_after_fixture() to begin tracking teardown fixtures with proper parent_uuid parameter",
      "max_score": 20
    },
    {
      "name": "Fixture UUID management",
      "description": "Properly generates and manages unique UUIDs for fixtures using uuid4() or similar, and returns them from start methods",
      "max_score": 10
    },
    {
      "name": "stop_before_fixture usage",
      "description": "Correctly uses lifecycle.stop_before_fixture() to complete tracking of setup fixtures with the appropriate UUID",
      "max_score": 10
    },
    {
      "name": "stop_after_fixture usage",
      "description": "Correctly uses lifecycle.stop_after_fixture() to complete tracking of teardown fixtures with the appropriate UUID",
      "max_score": 10
    },
    {
      "name": "Fixture status tracking",
      "description": "Updates fixture status using update_before_fixture() or update_after_fixture() or by setting the status property on fixture results (Status.PASSED, Status.FAILED, Status.BROKEN)",
      "max_score": 10
    },
    {
      "name": "Timing capture",
      "description": "Captures fixture execution timing using start/stop timestamps, leveraging lifecycle timing or manual calculation to provide duration_ms",
      "max_score": 5
    },
    {
      "name": "Fixture data retrieval",
      "description": "Retrieves fixture results from the lifecycle using appropriate methods or internal data structures to generate the report",
      "max_score": 5
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-allure-python-commons

tile.json