tessl install tessl/pypi-fastcore@1.8.0Python supercharged for fastai development
Agent Success
Agent success rate when using this tile
56%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.37x
Baseline
Agent success rate without this tile
41%
{
"context": "This evaluation assesses how well the engineer uses fastcore's working_directory() context manager to temporarily change the working directory while loading configuration files from multiple locations. The focus is on proper usage of this specific fastcore utility rather than general programming practices.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses working_directory()",
"description": "The solution imports and uses fastcore.xtras.working_directory() (or from fastcore.all import working_directory) to temporarily change directories when reading config files",
"max_score": 40
},
{
"name": "Context manager pattern",
"description": "The working_directory() is used with the 'with' statement to ensure automatic restoration of the original working directory",
"max_score": 25
},
{
"name": "Temporary directory changes",
"description": "For each config directory, the solution uses working_directory() to temporarily switch to that directory before reading the config.ini file, rather than constructing absolute paths or permanently changing directories",
"max_score": 20
},
{
"name": "No manual chdir",
"description": "The solution does not use os.chdir() or similar manual directory changing functions, relying entirely on working_directory() for directory changes",
"max_score": 15
}
]
}