or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/yacs@0.1.x
tile.json

tessl/pypi-yacs

tessl install tessl/pypi-yacs@0.1.0

A lightweight library for defining and managing system configurations for scientific experimentation.

Agent Success

Agent success rate when using this tile

97%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.05x

Baseline

Agent success rate without this tile

92%

rubric.jsonevals/scenario-6/

{
  "context": "This criteria evaluates how well the engineer uses YACS's dynamic key addition control (NEW_ALLOWED) feature to implement a plugin configuration system with different validation levels for different configuration sections.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "CfgNode initialization",
      "description": "Creates configuration using CfgNode (or imported as CN) from yacs.config for the main config and its sections (CORE, PLUGINS, USER_PREFS)",
      "max_score": 15
    },
    {
      "name": "PLUGINS new_allowed=True",
      "description": "Initializes PLUGINS section with new_allowed=True parameter (e.g., CN(new_allowed=True)) to allow arbitrary plugin keys",
      "max_score": 25
    },
    {
      "name": "CORE strict validation",
      "description": "CORE section uses default new_allowed=False behavior (or explicitly sets it to False) to prevent undefined keys from being added",
      "max_score": 15
    },
    {
      "name": "merge_from_list usage",
      "description": "Uses merge_from_list() method to load plugin configurations from the key-value list format",
      "max_score": 15
    },
    {
      "name": "is_new_allowed() check",
      "description": "Uses is_new_allowed() method to check whether a configuration section accepts new keys",
      "max_score": 15
    },
    {
      "name": "set_new_allowed() toggle",
      "description": "Uses set_new_allowed(True) method to enable dynamic key addition for the USER_PREFS section",
      "max_score": 15
    }
  ]
}