tessl install tessl/pypi-yacs@0.1.0A lightweight library for defining and managing system configurations for scientific experimentation.
Agent Success
Agent success rate when using this tile
97%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.05x
Baseline
Agent success rate without this tile
92%
{
"context": "This criteria evaluates how effectively the engineer uses the yacs package to implement deep cloning of configurations, specifically focusing on proper usage of CfgNode for configuration management and the clone() method for creating independent configuration copies.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses CfgNode",
"description": "Imports and uses the CfgNode class (typically as 'from yacs.config import CfgNode as CN') to create configuration objects instead of plain dictionaries or other data structures.",
"max_score": 20
},
{
"name": "Implements clone() method",
"description": "Uses the clone() method to create independent copies of the base configuration rather than attempting manual copying, shallow copies, or other approaches.",
"max_score": 30
},
{
"name": "Nested CfgNode structure",
"description": "Creates nested configuration sections (MODEL, DATA, TRAINING) using CfgNode objects for each section, properly utilizing the hierarchical configuration capability of yacs.",
"max_score": 20
},
{
"name": "Attribute-style access",
"description": "Accesses and modifies configuration values using yacs' attribute-style access pattern (e.g., cfg.MODEL.LEARNING_RATE) or dict-style access (e.g., cfg['MODEL']['LEARNING_RATE']).",
"max_score": 15
},
{
"name": "Type-appropriate values",
"description": "Uses yacs-compatible types (str, int, float, bool, tuple, list, None, CfgNode) for all configuration values, demonstrating understanding of yacs type restrictions.",
"max_score": 15
}
]
}