CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-types-chardet

Type stubs for chardet - Universal encoding detector for Python

Agent Success

Agent success rate when using this tile

65%

Improvement

Agent success rate improvement when using this tile compared to baseline

0.97x

Baseline

Agent success rate without this tile

67%

Overview
Eval results
Files

rubric.jsonevals/scenario-8/

{
  "context": "Evaluates whether the solution leverages ts_utils.paths to derive canonical stub, test, test-case, and allowlist locations for stdlib and third-party distributions, and formats those paths as specified. Focus is entirely on correct use of the repository layout helpers rather than hand-built path logic.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Stub root via helper",
      "description": "Uses ts_utils.paths.distribution_path to obtain the stub directory for both stdlib and third-party distributions instead of manual joins.",
      "max_score": 20
    },
    {
      "name": "Tests dir helper",
      "description": "Derives the @tests directory with ts_utils.paths.tests_path for any distribution, covering the stdlib special-case layout.",
      "max_score": 15
    },
    {
      "name": "Test cases helper",
      "description": "Populates the test_cases path using ts_utils.paths.test_cases_path rather than constructing the subfolder manually.",
      "max_score": 15
    },
    {
      "name": "Allowlists helper",
      "description": "Resolves the allowlists directory through ts_utils.paths.allowlists_path so stdlib maps to @tests/stubtest_allowlists and third-party stubs reuse their @tests folder.",
      "max_score": 15
    },
    {
      "name": "Stdlib handling",
      "description": "Ensures the \"stdlib\" distribution flows through the helper APIs (not hardcoded strings) so its stub, tests, test_cases, and allowlists paths match the canonical layout.",
      "max_score": 15
    },
    {
      "name": "Formatted output",
      "description": "format_layout emits newline-delimited entries (stub/tests/test_cases/allowlists) derived from the helper-produced Path objects and supports optional relative output when a base is provided.",
      "max_score": 20
    }
  ]
}
tessl i tessl/pypi-types-chardet@4.0.0

tile.json