CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-types-chardet

Type stubs for chardet - Universal encoding detector for Python

Agent Success

Agent success rate when using this tile

65%

Improvement

Agent success rate improvement when using this tile compared to baseline

0.97x

Baseline

Agent success rate without this tile

67%

Overview
Eval results
Files

rubric.jsonevals/scenario-5/

{
  "context": "Evaluates how well the solution leverages ts_utils to plan stubtest runs: gitignore-aware discovery, repository path helpers, allowlist construction, and cross-platform temporary config handling. Scoring is based solely on correct and idiomatic use of the package APIs named below.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Gitignore spec",
      "description": "Loads the repository .gitignore with ts_utils.utils.get_gitignore_spec and applies spec_matches_path to skip ignored test directories instead of reimplementing matching logic.",
      "max_score": 20
    },
    {
      "name": "Repo paths",
      "description": "Resolves stdlib and third-party test locations via ts_utils.paths helpers (tests_path/test_cases_path/allowlists_path) rather than manual path joins.",
      "max_score": 20
    },
    {
      "name": "Test discovery",
      "description": "Uses ts_utils.utils.distribution_info or get_all_testcase_directories to enumerate distributions, enforce non-empty test_cases directories, and preserve stdlib-first ordering.",
      "max_score": 20
    },
    {
      "name": "Allowlist args",
      "description": "Builds stubtest allowlist CLI flags with ts_utils.utils.allowlists and allowlist_stubtest_arguments (or equivalent) honoring platform/version-specific files in the expected priority.",
      "max_score": 20
    },
    {
      "name": "Temp config",
      "description": "Writes temporary config files using ts_utils.utils.NamedTemporaryFile (or TemporaryFileWrapper) to keep files reopenable on Windows and cleans them up when the context ends.",
      "max_score": 20
    }
  ]
}
tessl i tessl/pypi-types-chardet@4.0.0

tile.json