Type stubs for chardet - Universal encoding detector for Python
Agent Success
Agent success rate when using this tile
65%
Improvement
Agent success rate improvement when using this tile compared to baseline
0.97x
Baseline
Agent success rate without this tile
67%
{
"context": "Evaluates whether the solution uses the typeshed utilities to read stub distribution mypy overrides and emit a temporary mypy config with plugin support. Focuses on using the helper APIs instead of reimplementing them.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Metadata parsing",
"description": "Per-module settings are loaded via `ts_utils.mypy.mypy_configuration_from_distribution` (or equivalent call built on `metadata_path`) instead of ad-hoc TOML parsing, so the mypy-tests sections drive the config content.",
"max_score": 25
},
{
"name": "Plugin list",
"description": "The global [mypy] plugins line comes directly from `StubtestSettings.mypy_plugins` (typically via `read_stubtest_settings`) and preserves the dot-joined ordering expected by `temporary_mypy_config_file`.",
"max_score": 25
},
{
"name": "Plugin configs",
"description": "Plugin-specific options are written by passing `StubtestSettings.mypy_plugins_config` into `ts_utils.mypy.temporary_mypy_config_file`, yielding `[mypy.plugins.<plugin>]` sections with each provided key/value pair.",
"max_score": 25
},
{
"name": "Context cleanup",
"description": "Relies on the `temporary_mypy_config_file` context manager (and its `TemporaryFileWrapper` return) to produce the config path during the with-block and ensure the file is closed/removed afterward, rather than manual temp file handling.",
"max_score": 25
}
]
}tessl i tessl/pypi-types-chardet@4.0.0docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9