Type stubs for chardet - Universal encoding detector for Python
Agent Success
Agent success rate when using this tile
65%
Improvement
Agent success rate improvement when using this tile compared to baseline
0.97x
Baseline
Agent success rate without this tile
67%
{
"context": "Evaluates whether the solution relies on typeshed's ts_utils helpers to assemble requirement and stdlib support data instead of custom parsing. Confirms the code interacts with the provided repository layout through those utilities rather than recreating their behavior.",
"type": "weighted_checklist",
"checklist": [
{
"name": "External deps",
"description": "Aggregates stub distribution requirements via ts_utils.requirements.get_external_stub_requirements (optionally after pointing ts_utils.paths to the provided root) rather than manually walking files.",
"max_score": 30
},
{
"name": "System deps",
"description": "Collects platform-specific stubtest system dependencies through ts_utils.requirements.get_stubtest_system_requirements using the requested platform parameter and selected distributions.",
"max_score": 25
},
{
"name": "Stdlib ranges",
"description": "Parses stdlib/VERSIONS with ts_utils.utils.parse_stdlib_versions_file and derives module ranges using ts_utils.utils.supported_versions_for_module (or the same logic) rather than re-parsing the file manually.",
"max_score": 25
},
{
"name": "Typechecker pin",
"description": "Reads the type checker requirement from requirements-tests.txt using ts_utils.utils.parse_requirements or ts_utils.utils.get_mypy_req, not hand-coded constants.",
"max_score": 20
}
]
}tessl i tessl/pypi-types-chardet@4.0.0docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9