A simple immutable dictionary implementation with hashing support and performance optimizations
85
Pending
Does it follow best practices?
Impact
85%
1.30xAverage score across 10 eval scenarios
Pending
The risk profile of this skill
{
"context": "This criteria evaluates how effectively the engineer uses frozendict's serialization and copy capabilities. The focus is on proper usage of pickle serialization, protocol handling, and copy operations that leverage frozendict's immutability optimizations.",
"type": "weighted_checklist",
"checklist": [
{
"name": "frozendict usage",
"description": "Uses frozendict to create immutable configuration objects in the create_config function",
"max_score": 20
},
{
"name": "pickle serialization",
"description": "Uses pickle.dumps() to serialize frozendict objects in serialize_config function, properly handling the protocol parameter",
"max_score": 20
},
{
"name": "pickle deserialization",
"description": "Uses pickle.loads() to deserialize bytes back into frozendict objects in deserialize_config function",
"max_score": 15
},
{
"name": "shallow copy",
"description": "Uses copy.copy() to create shallow copies of frozendict objects in shallow_copy_config function",
"max_score": 15
},
{
"name": "deep copy",
"description": "Uses copy.deepcopy() to create deep copies of frozendict objects in deep_copy_config function",
"max_score": 15
},
{
"name": "protocol compatibility",
"description": "Correctly passes the protocol parameter to pickle.dumps() when specified, defaulting appropriately when None",
"max_score": 15
}
]
}evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10