tessl install tessl/pypi-yacs@0.1.0A lightweight library for defining and managing system configurations for scientific experimentation.
Agent Success
Agent success rate when using this tile
97%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.05x
Baseline
Agent success rate without this tile
92%
{
"context": "This criteria evaluates how well the engineer uses the YACS library to implement a configuration container with dual access patterns (attribute-style and dictionary-style). The focus is on proper usage of the CfgNode class and its core features.",
"type": "weighted_checklist",
"checklist": [
{
"name": "CfgNode Usage",
"description": "Uses yacs.config.CfgNode (or imports it as CN) as the base class or wraps it appropriately in the ConfigNode implementation",
"max_score": 30
},
{
"name": "Attribute Access",
"description": "Properly implements or leverages CfgNode's attribute-style access pattern (e.g., config.SYSTEM.NUM_GPUS) for reading configuration values",
"max_score": 20
},
{
"name": "Dictionary Access",
"description": "Properly implements or leverages CfgNode's dictionary-style access pattern (e.g., config['SYSTEM']['NUM_WORKERS']) for reading configuration values",
"max_score": 20
},
{
"name": "Nested Structures",
"description": "Correctly handles nested configuration hierarchies by ensuring nested dictionaries are converted to CfgNode objects (or ConfigNode objects) to support both access patterns at all levels",
"max_score": 15
},
{
"name": "Type Validation",
"description": "Leverages CfgNode's built-in type validation that restricts values to allowed types (str, int, float, bool, tuple, list, None, CfgNode) and properly raises errors for invalid types like set or complex",
"max_score": 15
}
]
}