or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/tox-pyenv@1.1.x
tile.json

tessl/pypi-tox-pyenv

tessl install tessl/pypi-tox-pyenv@1.1.0

tox plugin that makes tox use `pyenv which` to find python executables

Agent Success

Agent success rate when using this tile

98%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.03x

Baseline

Agent success rate without this tile

95%

rubric.jsonevals/scenario-1/

{
  "context": "This evaluation assesses how well the engineer uses tox's plugin system to implement custom argument parsing and configuration management. It focuses on proper usage of the tox_addoption hook, argument parser extensions, testenv attributes, and postprocessing logic.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Hook implementation",
      "description": "Correctly implements the tox_addoption hook using the @hookimpl decorator from tox to extend the plugin system",
      "max_score": 15
    },
    {
      "name": "Argument group creation",
      "description": "Creates a dedicated argument group using parser.argparser.add_argument_group() with the title 'verbosity plugin options' as specified",
      "max_score": 15
    },
    {
      "name": "Command-line argument",
      "description": "Adds the --verbose-output command-line argument with short form -V using add_argument() on the argument group, with correct dest, action, and default parameters",
      "max_score": 20
    },
    {
      "name": "Testenv attribute registration",
      "description": "Registers verbose_output as a testenv configuration attribute using parser.add_testenv_attribute() with correct name, type='bool', default, and help parameters",
      "max_score": 20
    },
    {
      "name": "Postprocessing function",
      "description": "Implements a postprocessing function and passes it to the add_testenv_attribute() postprocess parameter to handle merging of CLI and config settings",
      "max_score": 20
    },
    {
      "name": "Precedence logic",
      "description": "The postprocessing function correctly implements precedence by accessing testenv_config.config.option to get CLI values and ensuring CLI overrides config file values",
      "max_score": 10
    }
  ]
}