Library of web-related functions for HTML manipulation, HTTP processing, URL handling, and encoding detection
84
{
"context": "This criteria evaluates how effectively the engineer uses the w3lib library's URL canonicalization capabilities to solve the URL deduplication problem. The focus is on proper utilization of w3lib's canonicalize_url function and understanding its parameters.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses canonicalize_url",
"description": "Implementation uses w3lib.url.canonicalize_url() function as the core approach for URL normalization",
"max_score": 40
},
{
"name": "Proper function import",
"description": "Correctly imports canonicalize_url from w3lib.url module (e.g., 'from w3lib.url import canonicalize_url')",
"max_score": 15
},
{
"name": "Query parameter handling",
"description": "Solution correctly handles query parameter ordering, either through canonicalize_url's default behavior or by understanding its keep_blank_values parameter",
"max_score": 15
},
{
"name": "Fragment handling",
"description": "Solution correctly handles URL fragments, either through canonicalize_url's default behavior or by using the keep_fragments parameter appropriately",
"max_score": 15
},
{
"name": "Encoding parameter usage",
"description": "Demonstrates awareness of encoding considerations by either using the default encoding or explicitly setting the encoding parameter in canonicalize_url",
"max_score": 15
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-w3libevals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10