or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/yacs@0.1.x
tile.json

tessl/pypi-yacs

tessl install tessl/pypi-yacs@0.1.0

A lightweight library for defining and managing system configurations for scientific experimentation.

Agent Success

Agent success rate when using this tile

97%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.05x

Baseline

Agent success rate without this tile

92%

rubric.jsonevals/scenario-5/

{
  "context": "This criteria evaluates how effectively the engineer uses the yacs package to implement deep cloning of configurations, specifically focusing on proper usage of CfgNode for configuration management and the clone() method for creating independent configuration copies.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses CfgNode",
      "description": "Imports and uses the CfgNode class (typically as 'from yacs.config import CfgNode as CN') to create configuration objects instead of plain dictionaries or other data structures.",
      "max_score": 20
    },
    {
      "name": "Implements clone() method",
      "description": "Uses the clone() method to create independent copies of the base configuration rather than attempting manual copying, shallow copies, or other approaches.",
      "max_score": 30
    },
    {
      "name": "Nested CfgNode structure",
      "description": "Creates nested configuration sections (MODEL, DATA, TRAINING) using CfgNode objects for each section, properly utilizing the hierarchical configuration capability of yacs.",
      "max_score": 20
    },
    {
      "name": "Attribute-style access",
      "description": "Accesses and modifies configuration values using yacs' attribute-style access pattern (e.g., cfg.MODEL.LEARNING_RATE) or dict-style access (e.g., cfg['MODEL']['LEARNING_RATE']).",
      "max_score": 15
    },
    {
      "name": "Type-appropriate values",
      "description": "Uses yacs-compatible types (str, int, float, bool, tuple, list, None, CfgNode) for all configuration values, demonstrating understanding of yacs type restrictions.",
      "max_score": 15
    }
  ]
}