or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/allure-python-commons@2.15.x
tile.json

tessl/pypi-allure-python-commons

tessl install tessl/pypi-allure-python-commons@2.15.0

Contains the API for end users as well as helper functions and classes to build Allure adapters for Python test frameworks

Agent Success

Agent success rate when using this tile

94%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.27x

Baseline

Agent success rate without this tile

74%

rubric.jsonevals/scenario-3/

{
  "context": "This criteria evaluates how well the engineer uses allure-python-commons test metadata decorators to enhance test documentation and reporting. The focus is on proper usage of @allure.title, @allure.description, @allure.description_html, @allure.severity, @allure.tag, @allure.label, and allure.dynamic API.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Title decorators",
      "description": "Uses @allure.title() decorator to set custom titles on all four test functions (User Authentication, Product Search, Payment Processing, Admin Dashboard tests)",
      "max_score": 20
    },
    {
      "name": "Text description",
      "description": "Uses @allure.description() decorator to add text descriptions to the User Authentication Test, Product Search Test, and Payment Processing Test",
      "max_score": 15
    },
    {
      "name": "HTML description",
      "description": "Uses @allure.description_html() decorator on the Product Search Test with HTML formatting including bold text",
      "max_score": 10
    },
    {
      "name": "Severity levels",
      "description": "Uses @allure.severity() decorator with correct severity levels: CRITICAL for User Authentication Test, NORMAL for Product Search Test, BLOCKER for Payment Processing Test, and MINOR for Admin Dashboard Test. Uses allure.severity_level constants (e.g., allure.severity_level.CRITICAL)",
      "max_score": 20
    },
    {
      "name": "Tag decorators",
      "description": "Uses @allure.tag() decorator to apply tags: 'api' and 'auth' tags on User Authentication Test, 'api' and 'search' on Product Search Test, 'api', 'payment', and 'critical-path' on Payment Processing Test, and 'admin' on Admin Dashboard Test",
      "max_score": 15
    },
    {
      "name": "Custom labels",
      "description": "Uses @allure.label() decorator on Payment Processing Test to add custom label with label_type='payment_gateway' and value='stripe'",
      "max_score": 10
    },
    {
      "name": "Dynamic metadata",
      "description": "Uses allure.dynamic.title() function inside the Admin Dashboard Test to dynamically set the title based on a test parameter or variable at runtime",
      "max_score": 10
    }
  ]
}