Type stubs for chardet - Universal encoding detector for Python
Agent Success
Agent success rate when using this tile
65%
Improvement
Agent success rate improvement when using this tile compared to baseline
0.97x
Baseline
Agent success rate without this tile
67%
{
"context": "Evaluates whether the solution leverages ts_utils.paths to derive canonical stub, test, test-case, and allowlist locations for stdlib and third-party distributions, and formats those paths as specified. Focus is entirely on correct use of the repository layout helpers rather than hand-built path logic.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Stub root via helper",
"description": "Uses ts_utils.paths.distribution_path to obtain the stub directory for both stdlib and third-party distributions instead of manual joins.",
"max_score": 20
},
{
"name": "Tests dir helper",
"description": "Derives the @tests directory with ts_utils.paths.tests_path for any distribution, covering the stdlib special-case layout.",
"max_score": 15
},
{
"name": "Test cases helper",
"description": "Populates the test_cases path using ts_utils.paths.test_cases_path rather than constructing the subfolder manually.",
"max_score": 15
},
{
"name": "Allowlists helper",
"description": "Resolves the allowlists directory through ts_utils.paths.allowlists_path so stdlib maps to @tests/stubtest_allowlists and third-party stubs reuse their @tests folder.",
"max_score": 15
},
{
"name": "Stdlib handling",
"description": "Ensures the \"stdlib\" distribution flows through the helper APIs (not hardcoded strings) so its stub, tests, test_cases, and allowlists paths match the canonical layout.",
"max_score": 15
},
{
"name": "Formatted output",
"description": "format_layout emits newline-delimited entries (stub/tests/test_cases/allowlists) derived from the helper-produced Path objects and supports optional relative output when a base is provided.",
"max_score": 20
}
]
}tessl i tessl/pypi-types-chardet@4.0.0docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9