Type stubs for chardet - Universal encoding detector for Python
Agent Success
Agent success rate when using this tile
65%
Improvement
Agent success rate improvement when using this tile compared to baseline
0.97x
Baseline
Agent success rate without this tile
67%
{
"context": "Evaluates whether the solution uses the typeshed metadata utilities to parse, validate, and summarize stub package information without reimplementing TOML handling. Focus is on leveraging the provided helpers for metadata, dependencies, and stubtest settings to drive the outputs described in the spec.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Metadata parsing",
"description": "Uses ts_utils.metadata.read_metadata to load stub details (version spec, upload flags, partial_stub, upstream, requires_python) instead of manual TOML parsing, and surfaces validated values in the summary.",
"max_score": 30
},
{
"name": "Dependency split",
"description": "Derives typeshed vs external dependency lists via ts_utils.metadata.read_dependencies (or the returned PackageDependencies object) so stub dependencies are normalized with typeshed mappings rather than hand-built parsing.",
"max_score": 25
},
{
"name": "Stubtest settings",
"description": "Pulls CI platforms and other stubtest settings through ts_utils.metadata.read_stubtest_settings and reflects them in summaries (including respecting skip/ci_platforms defaults).",
"max_score": 25
},
{
"name": "Platform requirements",
"description": "When a platform is provided, obtains system requirements using StubtestSettings.system_requirements_for_platform and applies the helper's validation for unsupported platforms rather than custom logic.",
"max_score": 15
},
{
"name": "Missing stubs",
"description": "Propagates or wraps NoSuchStubError from the metadata helpers to signal absent METADATA.toml entries, keeping the error tied to the requested distribution name.",
"max_score": 5
}
]
}tessl i tessl/pypi-types-chardet@4.0.0docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9