tox plugin that makes tox use `pyenv which` to find python executables
98
Pending
Does it follow best practices?
Impact
98%
1.03xAverage score across 10 eval scenarios
Pending
The risk profile of this skill
{
"context": "This evaluation assesses how well the engineer uses tox-pyenv's logging and debugging capabilities to provide visibility into plugin behavior, error conditions, and fallback scenarios. The focus is on proper use of Python's logging module and appropriate logging levels for different scenarios.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Logger initialization",
"description": "Creates a module-level logger using logging.getLogger(__name__) to properly integrate with Python's logging system",
"max_score": 15
},
{
"name": "Warning log usage",
"description": "Uses LOG.warning() to log a message when pyenv is not installed (OSError is caught), indicating the plugin may not be needed",
"max_score": 25
},
{
"name": "Debug log usage",
"description": "Uses LOG.debug() to log detailed information when pyenv fails to find a Python version and fallback occurs",
"max_score": 25
},
{
"name": "Command logging",
"description": "Includes the exact pyenv command that was executed (e.g., 'pyenv which python3.8') in the debug log message",
"max_score": 15
},
{
"name": "Error output logging",
"description": "Captures and includes stderr output from failed pyenv commands in the debug log message to aid troubleshooting",
"max_score": 20
}
]
}docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10