or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/yacs@0.1.x
tile.json

tessl/pypi-yacs

tessl install tessl/pypi-yacs@0.1.0

A lightweight library for defining and managing system configurations for scientific experimentation.

Agent Success

Agent success rate when using this tile

97%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.05x

Baseline

Agent success rate without this tile

92%

rubric.jsonevals/scenario-3/

{
  "context": "This criteria evaluates how well the engineer uses YACS's safe value decoding capability, specifically the merge_from_list() method with its built-in literal_eval functionality for parsing command-line string arguments into properly typed Python values.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "CfgNode instantiation",
      "description": "Creates configuration using CfgNode class from yacs.config module to establish the base configuration structure",
      "max_score": 15
    },
    {
      "name": "Hierarchical structure",
      "description": "Properly creates nested configuration groups (MODEL, TRAIN, SYSTEM, DATA) as CfgNode objects with correct key-value pairs matching the specification",
      "max_score": 15
    },
    {
      "name": "merge_from_list usage",
      "description": "Uses the merge_from_list() method to apply command-line overrides to the configuration, which is the primary YACS mechanism for handling CLI arguments",
      "max_score": 40
    },
    {
      "name": "Automatic type conversion",
      "description": "Relies on YACS's built-in _decode_cfg_value() with literal_eval to automatically convert string inputs to appropriate types (int, float, bool, tuple) without manual parsing",
      "max_score": 20
    },
    {
      "name": "Dot notation keys",
      "description": "Correctly passes keys in dot notation format (e.g., 'TRAIN.LEARNING_RATE') to merge_from_list(), allowing YACS to properly navigate nested configuration structure",
      "max_score": 10
    }
  ]
}