A simple immutable dictionary implementation with hashing support and performance optimizations
85
Pending
Does it follow best practices?
Impact
85%
1.30xAverage score across 10 eval scenarios
Pending
The risk profile of this skill
{
"context": "This criteria evaluates how well the engineer uses frozendict's deep freezing functionality to create immutable configuration snapshots. The focus is on proper usage of deepfreeze(), register(), and getFreezeConversionMap() functions.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses deepfreeze function",
"description": "The create_snapshot function correctly imports and uses deepfreeze() from frozendict to recursively convert the configuration dictionary to immutable form",
"max_score": 30
},
{
"name": "Passes correct parameters",
"description": "The deepfreeze() function is called with the config parameter, and optional custom_converters parameter is used if needed",
"max_score": 15
},
{
"name": "Uses register function",
"description": "The register_config_type function correctly imports and uses register() from frozendict to register the custom type converter",
"max_score": 25
},
{
"name": "Correct register parameters",
"description": "The register() function is called with the type_class as the first parameter and converter_func as the second parameter",
"max_score": 15
},
{
"name": "Uses getFreezeConversionMap",
"description": "The get_converter_info function correctly imports and uses getFreezeConversionMap() from frozendict to retrieve the conversion mappings",
"max_score": 15
}
]
}evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10