CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-yacs

A lightweight library for defining and managing system configurations for scientific experimentation.

Overall
score

97%

Evaluation97%

1.05x

Agent success when using this tile

Overview
Eval results
Files

rubric.jsonevals/scenario-2/

{
  "context": "This criteria evaluates how well the engineer uses the YACS library to implement a configuration container with dual access patterns (attribute-style and dictionary-style). The focus is on proper usage of the CfgNode class and its core features.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "CfgNode Usage",
      "description": "Uses yacs.config.CfgNode (or imports it as CN) as the base class or wraps it appropriately in the ConfigNode implementation",
      "max_score": 30
    },
    {
      "name": "Attribute Access",
      "description": "Properly implements or leverages CfgNode's attribute-style access pattern (e.g., config.SYSTEM.NUM_GPUS) for reading configuration values",
      "max_score": 20
    },
    {
      "name": "Dictionary Access",
      "description": "Properly implements or leverages CfgNode's dictionary-style access pattern (e.g., config['SYSTEM']['NUM_WORKERS']) for reading configuration values",
      "max_score": 20
    },
    {
      "name": "Nested Structures",
      "description": "Correctly handles nested configuration hierarchies by ensuring nested dictionaries are converted to CfgNode objects (or ConfigNode objects) to support both access patterns at all levels",
      "max_score": 15
    },
    {
      "name": "Type Validation",
      "description": "Leverages CfgNode's built-in type validation that restricts values to allowed types (str, int, float, bool, tuple, list, None, CfgNode) and properly raises errors for invalid types like set or complex",
      "max_score": 15
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-yacs

tile.json