CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-types-chardet

Type stubs for chardet - Universal encoding detector for Python

Agent Success

Agent success rate when using this tile

65%

Improvement

Agent success rate improvement when using this tile compared to baseline

0.97x

Baseline

Agent success rate without this tile

67%

Overview
Eval results
Files

rubric.jsonevals/scenario-7/

{
  "context": "Evaluates whether the solution uses the typeshed utilities to read stub distribution mypy overrides and emit a temporary mypy config with plugin support. Focuses on using the helper APIs instead of reimplementing them.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Metadata parsing",
      "description": "Per-module settings are loaded via `ts_utils.mypy.mypy_configuration_from_distribution` (or equivalent call built on `metadata_path`) instead of ad-hoc TOML parsing, so the mypy-tests sections drive the config content.",
      "max_score": 25
    },
    {
      "name": "Plugin list",
      "description": "The global [mypy] plugins line comes directly from `StubtestSettings.mypy_plugins` (typically via `read_stubtest_settings`) and preserves the dot-joined ordering expected by `temporary_mypy_config_file`.",
      "max_score": 25
    },
    {
      "name": "Plugin configs",
      "description": "Plugin-specific options are written by passing `StubtestSettings.mypy_plugins_config` into `ts_utils.mypy.temporary_mypy_config_file`, yielding `[mypy.plugins.<plugin>]` sections with each provided key/value pair.",
      "max_score": 25
    },
    {
      "name": "Context cleanup",
      "description": "Relies on the `temporary_mypy_config_file` context manager (and its `TemporaryFileWrapper` return) to produce the config path during the with-block and ensure the file is closed/removed afterward, rather than manual temp file handling.",
      "max_score": 25
    }
  ]
}
tessl i tessl/pypi-types-chardet@4.0.0

tile.json