tessl install tessl/pypi-invoke@2.2.0Pythonic task execution library for managing shell-oriented subprocesses and organizing executable Python code into CLI-invokable tasks
Agent Success
Agent success rate when using this tile
96%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.25x
Baseline
Agent success rate without this tile
77%
{
"context": "This evaluation assesses how well the engineer uses Invoke's custom task class capability (klass parameter) to extend the Task class and implement automatic execution logging. The focus is on proper usage of Invoke's extensibility features for custom task behavior.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Custom Task subclass",
"description": "Creates a custom task class that properly inherits from invoke.Task (or invoke.task.Task)",
"max_score": 20
},
{
"name": "klass parameter usage",
"description": "Uses the klass parameter in @task decorator to specify the custom LoggingTask class for the build and test tasks",
"max_score": 25
},
{
"name": "Task execution override",
"description": "Overrides the appropriate Task method(s) such as __call__() or execute() to add logging behavior before and after task execution",
"max_score": 25
},
{
"name": "Context passing",
"description": "Properly handles the Context object (c parameter) by passing it through to the parent Task class or wrapped function",
"max_score": 15
},
{
"name": "Logging implementation",
"description": "Implements logging functionality that captures task name, timestamps, and duration, writing to 'task_log.txt' as specified",
"max_score": 15
}
]
}