or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/allure-python-commons@2.15.x
tile.json

tessl/pypi-allure-python-commons

tessl install tessl/pypi-allure-python-commons@2.15.0

Contains the API for end users as well as helper functions and classes to build Allure adapters for Python test frameworks

Agent Success

Agent success rate when using this tile

94%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.27x

Baseline

Agent success rate without this tile

74%

rubric.jsonevals/scenario-10/

{
  "context": "This criteria evaluates how well the engineer uses the allure-python-commons plugin system and hooks to build a custom reporting plugin. It focuses on proper hook implementation, plugin registration, and understanding of the plugin architecture.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Plugin Registration",
      "description": "Uses plugin_manager.register() to register the custom plugin instance with the allure plugin system",
      "max_score": 15
    },
    {
      "name": "Hook Implementation Decorator",
      "description": "Uses @hookimpl decorator from allure_commons._hooks to mark hook implementation methods",
      "max_score": 15
    },
    {
      "name": "Description Hook",
      "description": "Implements add_description hook to intercept and modify test descriptions by adding timestamp prefix",
      "max_score": 20
    },
    {
      "name": "Step Start Hook",
      "description": "Implements start_step hook to track test step execution with parameters uuid, title, and params",
      "max_score": 20
    },
    {
      "name": "File Attachment Hook",
      "description": "Implements attach_file hook to intercept file attachments with parameters source, name, attachment_type, and extension",
      "max_score": 20
    },
    {
      "name": "Modified Return Values",
      "description": "Returns modified values from hooks (e.g., modified description from add_description, modified title from start_step) to affect the reporting behavior",
      "max_score": 10
    }
  ]
}