Type stubs for chardet - Universal encoding detector for Python
Agent Success
Agent success rate when using this tile
65%
Improvement
Agent success rate improvement when using this tile compared to baseline
0.97x
Baseline
Agent success rate without this tile
67%
{
"context": "Evaluates how well the solution leverages ts_utils to plan stubtest runs: gitignore-aware discovery, repository path helpers, allowlist construction, and cross-platform temporary config handling. Scoring is based solely on correct and idiomatic use of the package APIs named below.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Gitignore spec",
"description": "Loads the repository .gitignore with ts_utils.utils.get_gitignore_spec and applies spec_matches_path to skip ignored test directories instead of reimplementing matching logic.",
"max_score": 20
},
{
"name": "Repo paths",
"description": "Resolves stdlib and third-party test locations via ts_utils.paths helpers (tests_path/test_cases_path/allowlists_path) rather than manual path joins.",
"max_score": 20
},
{
"name": "Test discovery",
"description": "Uses ts_utils.utils.distribution_info or get_all_testcase_directories to enumerate distributions, enforce non-empty test_cases directories, and preserve stdlib-first ordering.",
"max_score": 20
},
{
"name": "Allowlist args",
"description": "Builds stubtest allowlist CLI flags with ts_utils.utils.allowlists and allowlist_stubtest_arguments (or equivalent) honoring platform/version-specific files in the expected priority.",
"max_score": 20
},
{
"name": "Temp config",
"description": "Writes temporary config files using ts_utils.utils.NamedTemporaryFile (or TemporaryFileWrapper) to keep files reopenable on Windows and cleans them up when the context ends.",
"max_score": 20
}
]
}tessl i tessl/pypi-types-chardet@4.0.0docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9