tox plugin that makes tox use `pyenv which` to find python executables
Overall
score
98%
{
"context": "This evaluation assesses how well the engineer uses tox's plugin system to implement custom argument parsing and configuration management. It focuses on proper usage of the tox_addoption hook, argument parser extensions, testenv attributes, and postprocessing logic.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Hook implementation",
"description": "Correctly implements the tox_addoption hook using the @hookimpl decorator from tox to extend the plugin system",
"max_score": 15
},
{
"name": "Argument group creation",
"description": "Creates a dedicated argument group using parser.argparser.add_argument_group() with the title 'verbosity plugin options' as specified",
"max_score": 15
},
{
"name": "Command-line argument",
"description": "Adds the --verbose-output command-line argument with short form -V using add_argument() on the argument group, with correct dest, action, and default parameters",
"max_score": 20
},
{
"name": "Testenv attribute registration",
"description": "Registers verbose_output as a testenv configuration attribute using parser.add_testenv_attribute() with correct name, type='bool', default, and help parameters",
"max_score": 20
},
{
"name": "Postprocessing function",
"description": "Implements a postprocessing function and passes it to the add_testenv_attribute() postprocess parameter to handle merging of CLI and config settings",
"max_score": 20
},
{
"name": "Precedence logic",
"description": "The postprocessing function correctly implements precedence by accessing testenv_config.config.option to get CLI values and ensuring CLI overrides config file values",
"max_score": 10
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-tox-pyenvdocs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10