tessl install tessl/npm-jest-circus@29.7.0The next-gen flux-based test runner for Jest that provides test framework globals and event-driven test execution
Agent Success
Agent success rate when using this tile
82%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.91x
Baseline
Agent success rate without this tile
43%
{
"context": "This criteria evaluates the engineer's ability to use Jest's test retry functionality (jest.retryTimes) to handle flaky tests effectively. The focus is on proper configuration of retry counts and understanding when retries should be applied to different test scenarios.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses jest.retryTimes",
"description": "The test file correctly calls jest.retryTimes() to configure automatic test retries for handling flaky behavior",
"max_score": 30
},
{
"name": "Basic retry count",
"description": "Configures jest.retryTimes() with an appropriate number of retries (at least 3) for the fetchUser and fetchPosts tests",
"max_score": 25
},
{
"name": "Different retry counts",
"description": "Uses different retry configurations for different tests by calling jest.retryTimes() with a higher count (at least 5) for the createPost test to handle its higher failure rate",
"max_score": 25
},
{
"name": "Retry scope placement",
"description": "Calls jest.retryTimes() in the appropriate scope (e.g., within describe blocks or before specific tests) to apply retries correctly to the intended tests",
"max_score": 20
}
]
}