CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-yacs

A lightweight library for defining and managing system configurations for scientific experimentation.

Overall
score

97%

Evaluation97%

1.05x

Agent success when using this tile

Overview
Eval results
Files

Evaluation results

100%

60%

ML Training Configuration CLI

Configuration merging from key-value lists (CLI overrides)

Criteria
Without context
With context

CfgNode instantiation

100%

100%

Hierarchical structure

100%

100%

merge_from_list usage

0%

100%

Key-value list format

0%

100%

Type handling

0%

100%

Configuration output

100%

100%

100%

Configuration Manager

Configuration container (CfgNode) with dual access patterns

Criteria
Without context
With context

CfgNode Usage

100%

100%

Attribute Access

100%

100%

Dictionary Access

100%

100%

Nested Structures

100%

100%

Type Validation

100%

100%

100%

Configuration Migration Tool

Renamed keys management with error messages

Criteria
Without context
With context

CfgNode instantiation

100%

100%

Configuration schema definition

100%

100%

register_renamed_key usage

100%

100%

merge_from_list usage

100%

100%

Error propagation

100%

100%

Error message content

100%

100%

100%

Configuration Profile Merger

Configuration merging from other CfgNode objects

Criteria
Without context
With context

CfgNode import

100%

100%

CfgNode creation

100%

100%

Nested configuration structure

100%

100%

merge_from_other_cfg usage

100%

100%

Correct merge behavior

100%

100%

Sequential merging

100%

100%

Return values

100%

100%

85%

-15%

Custom Configuration Validator

CfgNode subclassing for custom behavior

Criteria
Without context
With context

CfgNode subclassing

100%

100%

__setattr__ override

100%

40%

Super call preservation

100%

100%

Learning rate validation

100%

100%

Batch size validation

100%

100%

Optimizer validation

100%

100%

Factory function implementation

100%

100%

100%

Configuration CLI Override Parser

Safe value decoding with literal_eval

Criteria
Without context
With context

CfgNode instantiation

100%

100%

Hierarchical structure

100%

100%

merge_from_list usage

100%

100%

Automatic type conversion

100%

100%

Dot notation keys

100%

100%

100%

Configuration File Loader

Configuration merging from files (YAML/Python)

Criteria
Without context
With context

CfgNode instantiation

100%

100%

Nested configuration structure

100%

100%

merge_from_file() usage

100%

100%

YAML file handling

100%

100%

Python file handling

100%

100%

Configuration value access

100%

100%

100%

Configuration File Converter

YAML serialization and deserialization

Criteria
Without context
With context

CfgNode usage

100%

100%

load_cfg method

100%

100%

dump method

100%

100%

Type preservation

100%

100%

Nested structure handling

100%

100%

100%

Experiment Configuration Manager

Deep cloning of configurations

Criteria
Without context
With context

Uses CfgNode

100%

100%

Implements clone() method

100%

100%

Nested CfgNode structure

100%

100%

Attribute-style access

100%

100%

Type-appropriate values

100%

100%

85%

10%

Plugin Configuration Manager

Dynamic key addition control (NEW_ALLOWED)

Criteria
Without context
With context

CfgNode initialization

100%

100%

PLUGINS new_allowed=True

60%

100%

CORE strict validation

100%

100%

merge_from_list usage

0%

0%

is_new_allowed() check

100%

100%

set_new_allowed() toggle

100%

100%

Install with Tessl CLI

npx tessl i tessl/pypi-yacs
Evaluated
Agent
Claude Code

Table of Contents