or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/allure-python-commons@2.15.x
tile.json

tessl/pypi-allure-python-commons

tessl install tessl/pypi-allure-python-commons@2.15.0

Contains the API for end users as well as helper functions and classes to build Allure adapters for Python test frameworks

Agent Success

Agent success rate when using this tile

94%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.27x

Baseline

Agent success rate without this tile

74%

rubric.jsonevals/scenario-1/

{
  "context": "This criteria evaluates the engineer's ability to use the allure-python-commons package for parameter management, specifically focusing on the correct usage of allure.dynamic.parameter() with different parameter modes (DEFAULT, MASKED, HIDDEN) to control parameter visibility in test reports.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Import allure module",
      "description": "Correctly imports the allure module (e.g., 'import allure') and ParameterMode if needed (e.g., 'from allure_commons.types import ParameterMode' or uses allure.parameter_mode)",
      "max_score": 10
    },
    {
      "name": "Use allure.dynamic.parameter",
      "description": "Uses allure.dynamic.parameter() function to record parameters",
      "max_score": 20
    },
    {
      "name": "Record username parameter",
      "description": "Calls allure.dynamic.parameter('username', username) or with mode=ParameterMode.DEFAULT to record the username as visible",
      "max_score": 15
    },
    {
      "name": "Mask password parameter",
      "description": "Calls allure.dynamic.parameter('password', password, mode=ParameterMode.MASKED) to mask the password value in the report",
      "max_score": 20
    },
    {
      "name": "Record api_endpoint parameter",
      "description": "Calls allure.dynamic.parameter('api_endpoint', api_endpoint) or with mode=ParameterMode.DEFAULT to record the endpoint as visible",
      "max_score": 15
    },
    {
      "name": "Hide internal_debug_flag parameter",
      "description": "Calls allure.dynamic.parameter('internal_debug_flag', internal_debug_flag, mode=ParameterMode.HIDDEN) to hide the debug flag from the report",
      "max_score": 20
    }
  ]
}