CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-allure-python-commons

Contains the API for end users as well as helper functions and classes to build Allure adapters for Python test frameworks

Overall
score

94%

Overview
Eval results
Files

rubric.jsonevals/scenario-3/

{
  "context": "This criteria evaluates how well the engineer uses allure-python-commons test metadata decorators to enhance test documentation and reporting. The focus is on proper usage of @allure.title, @allure.description, @allure.description_html, @allure.severity, @allure.tag, @allure.label, and allure.dynamic API.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Title decorators",
      "description": "Uses @allure.title() decorator to set custom titles on all four test functions (User Authentication, Product Search, Payment Processing, Admin Dashboard tests)",
      "max_score": 20
    },
    {
      "name": "Text description",
      "description": "Uses @allure.description() decorator to add text descriptions to the User Authentication Test, Product Search Test, and Payment Processing Test",
      "max_score": 15
    },
    {
      "name": "HTML description",
      "description": "Uses @allure.description_html() decorator on the Product Search Test with HTML formatting including bold text",
      "max_score": 10
    },
    {
      "name": "Severity levels",
      "description": "Uses @allure.severity() decorator with correct severity levels: CRITICAL for User Authentication Test, NORMAL for Product Search Test, BLOCKER for Payment Processing Test, and MINOR for Admin Dashboard Test. Uses allure.severity_level constants (e.g., allure.severity_level.CRITICAL)",
      "max_score": 20
    },
    {
      "name": "Tag decorators",
      "description": "Uses @allure.tag() decorator to apply tags: 'api' and 'auth' tags on User Authentication Test, 'api' and 'search' on Product Search Test, 'api', 'payment', and 'critical-path' on Payment Processing Test, and 'admin' on Admin Dashboard Test",
      "max_score": 15
    },
    {
      "name": "Custom labels",
      "description": "Uses @allure.label() decorator on Payment Processing Test to add custom label with label_type='payment_gateway' and value='stripe'",
      "max_score": 10
    },
    {
      "name": "Dynamic metadata",
      "description": "Uses allure.dynamic.title() function inside the Admin Dashboard Test to dynamically set the title based on a test parameter or variable at runtime",
      "max_score": 10
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-allure-python-commons

tile.json