tessl install tessl/pypi-atheris@2.3.0A coverage-guided fuzzer for Python and Python extensions based on libFuzzer
Agent Success
Agent success rate when using this tile
91%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.28x
Baseline
Agent success rate without this tile
71%
{
"context": "This criteria evaluates how well the engineer uses atheris package capabilities to instrument and fuzz-test a URL parser function. The focus is on proper use of function-level instrumentation, fuzzing setup, and structured input generation.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Function instrumentation",
"description": "Uses the instrument_func() decorator or equivalent to instrument the parse_url function for coverage tracking",
"max_score": 30
},
{
"name": "Fuzzer initialization",
"description": "Correctly calls Setup() with sys.argv and the test callback function before starting fuzzing",
"max_score": 20
},
{
"name": "FuzzedDataProvider usage",
"description": "Uses FuzzedDataProvider to convert raw fuzzing bytes into structured string inputs (e.g., ConsumeUnicode, ConsumeUnicodeNoSurrogates, or ConsumeString)",
"max_score": 25
},
{
"name": "Fuzzer execution",
"description": "Calls Fuzz() to start the fuzzing loop, or uses -atheris_runs argument to control execution",
"max_score": 15
},
{
"name": "Test callback",
"description": "Implements test_one_input(data) function that accepts bytes and properly handles exceptions from the target function",
"max_score": 10
}
]
}