or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/yacs@0.1.x
tile.json

tessl/pypi-yacs

tessl install tessl/pypi-yacs@0.1.0

A lightweight library for defining and managing system configurations for scientific experimentation.

Agent Success

Agent success rate when using this tile

97%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.05x

Baseline

Agent success rate without this tile

92%

rubric.jsonevals/scenario-2/

{
  "context": "This criteria evaluates how well the engineer uses the YACS package to implement a configuration CLI system that merges command-line overrides. The focus is specifically on utilizing YACS's merge_from_list() capability and CfgNode configuration management.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "CfgNode instantiation",
      "description": "Uses yacs.config.CfgNode (or imports as CN) to create the configuration container object",
      "max_score": 15
    },
    {
      "name": "Hierarchical structure",
      "description": "Creates nested CfgNode objects to represent the hierarchical configuration structure (MODEL, TRAIN, DATA sections)",
      "max_score": 15
    },
    {
      "name": "merge_from_list usage",
      "description": "Uses the merge_from_list() method to apply command-line argument overrides to the configuration",
      "max_score": 30
    },
    {
      "name": "Key-value list format",
      "description": "Correctly passes command-line arguments to merge_from_list() as a list of alternating keys and values, preserving the CLI argument format",
      "max_score": 20
    },
    {
      "name": "Type handling",
      "description": "Leverages YACS's automatic type decoding from strings (merge_from_list automatically converts string values like '0.01', '128', 'True' to appropriate types)",
      "max_score": 10
    },
    {
      "name": "Configuration output",
      "description": "Uses CfgNode's dump() method or string representation to output the final configuration in readable format",
      "max_score": 10
    }
  ]
}