or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/atheris@2.3.x
tile.json

tessl/pypi-atheris

tessl install tessl/pypi-atheris@2.3.0

A coverage-guided fuzzer for Python and Python extensions based on libFuzzer

Agent Success

Agent success rate when using this tile

91%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.28x

Baseline

Agent success rate without this tile

71%

rubric.jsonevals/scenario-6/

{
  "context": "This evaluation assesses the engineer's ability to use atheris's instrument_imports() context manager for selective module instrumentation in a fuzzing harness. The focus is on proper usage of the import instrumentation API to instrument application code while excluding standard library modules.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "instrument_imports() usage",
      "description": "Uses atheris.instrument_imports() as a context manager to set up import instrumentation before importing any application modules",
      "max_score": 30
    },
    {
      "name": "Selective instrumentation",
      "description": "Configures instrument_imports() with include and/or exclude parameters to selectively instrument only application modules while excluding standard library modules (e.g., 'json')",
      "max_score": 30
    },
    {
      "name": "Import ordering",
      "description": "Places all imports that need instrumentation inside the instrument_imports() context manager scope, ensuring modules are imported after instrumentation is configured",
      "max_score": 25
    },
    {
      "name": "TestOneInput implementation",
      "description": "Implements TestOneInput(data: bytes) function that correctly processes fuzzer input and handles exceptions appropriately",
      "max_score": 15
    }
  ]
}