Ctrl + K
DocumentationLog inGet started

tessl/npm-jest-circus

tessl install tessl/npm-jest-circus@29.7.0

The next-gen flux-based test runner for Jest that provides test framework globals and event-driven test execution

Agent Success

Agent success rate when using this tile

82%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.91x

Baseline

Agent success rate without this tile

43%

rubric.jsonevals/scenario-9/

{
  "context": "This criteria evaluates the engineer's ability to use Jest's test retry functionality (jest.retryTimes) to handle flaky tests effectively. The focus is on proper configuration of retry counts and understanding when retries should be applied to different test scenarios.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses jest.retryTimes",
      "description": "The test file correctly calls jest.retryTimes() to configure automatic test retries for handling flaky behavior",
      "max_score": 30
    },
    {
      "name": "Basic retry count",
      "description": "Configures jest.retryTimes() with an appropriate number of retries (at least 3) for the fetchUser and fetchPosts tests",
      "max_score": 25
    },
    {
      "name": "Different retry counts",
      "description": "Uses different retry configurations for different tests by calling jest.retryTimes() with a higher count (at least 5) for the createPost test to handle its higher failure rate",
      "max_score": 25
    },
    {
      "name": "Retry scope placement",
      "description": "Calls jest.retryTimes() in the appropriate scope (e.g., within describe blocks or before specific tests) to apply retries correctly to the intended tests",
      "max_score": 20
    }
  ]
}

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
npmpkg:npm/jest-circus@29.7.x
tile.json