A lightweight library for defining and managing system configurations for scientific experimentation.
Overall
score
97%
Evaluation — 97%
↑ 1.05xAgent success when using this tile
{
"context": "This criteria evaluates how well the engineer uses the YACS library to implement a configuration container with dual access patterns (attribute-style and dictionary-style). The focus is on proper usage of the CfgNode class and its core features.",
"type": "weighted_checklist",
"checklist": [
{
"name": "CfgNode Usage",
"description": "Uses yacs.config.CfgNode (or imports it as CN) as the base class or wraps it appropriately in the ConfigNode implementation",
"max_score": 30
},
{
"name": "Attribute Access",
"description": "Properly implements or leverages CfgNode's attribute-style access pattern (e.g., config.SYSTEM.NUM_GPUS) for reading configuration values",
"max_score": 20
},
{
"name": "Dictionary Access",
"description": "Properly implements or leverages CfgNode's dictionary-style access pattern (e.g., config['SYSTEM']['NUM_WORKERS']) for reading configuration values",
"max_score": 20
},
{
"name": "Nested Structures",
"description": "Correctly handles nested configuration hierarchies by ensuring nested dictionaries are converted to CfgNode objects (or ConfigNode objects) to support both access patterns at all levels",
"max_score": 15
},
{
"name": "Type Validation",
"description": "Leverages CfgNode's built-in type validation that restricts values to allowed types (str, int, float, bool, tuple, list, None, CfgNode) and properly raises errors for invalid types like set or complex",
"max_score": 15
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-yacsdocs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10