CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-types-chardet

Type stubs for chardet - Universal encoding detector for Python

Agent Success

Agent success rate when using this tile

65%

Improvement

Agent success rate improvement when using this tile compared to baseline

0.97x

Baseline

Agent success rate without this tile

67%

Overview
Eval results
Files

rubric.jsonevals/scenario-9/

{
  "context": "Evaluates whether the solution uses the typeshed metadata utilities to parse, validate, and summarize stub package information without reimplementing TOML handling. Focus is on leveraging the provided helpers for metadata, dependencies, and stubtest settings to drive the outputs described in the spec.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Metadata parsing",
      "description": "Uses ts_utils.metadata.read_metadata to load stub details (version spec, upload flags, partial_stub, upstream, requires_python) instead of manual TOML parsing, and surfaces validated values in the summary.",
      "max_score": 30
    },
    {
      "name": "Dependency split",
      "description": "Derives typeshed vs external dependency lists via ts_utils.metadata.read_dependencies (or the returned PackageDependencies object) so stub dependencies are normalized with typeshed mappings rather than hand-built parsing.",
      "max_score": 25
    },
    {
      "name": "Stubtest settings",
      "description": "Pulls CI platforms and other stubtest settings through ts_utils.metadata.read_stubtest_settings and reflects them in summaries (including respecting skip/ci_platforms defaults).",
      "max_score": 25
    },
    {
      "name": "Platform requirements",
      "description": "When a platform is provided, obtains system requirements using StubtestSettings.system_requirements_for_platform and applies the helper's validation for unsupported platforms rather than custom logic.",
      "max_score": 15
    },
    {
      "name": "Missing stubs",
      "description": "Propagates or wraps NoSuchStubError from the metadata helpers to signal absent METADATA.toml entries, keeping the error tied to the requested distribution name.",
      "max_score": 5
    }
  ]
}
tessl i tessl/pypi-types-chardet@4.0.0

tile.json