or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/azure-batch@14.2.x
tile.json

tessl/pypi-azure-batch

tessl install tessl/pypi-azure-batch@14.2.0

Microsoft Azure Batch Client Library for Python providing comprehensive APIs for managing batch computing workloads in Azure cloud

Agent Success

Agent success rate when using this tile

91%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.07x

Baseline

Agent success rate without this tile

85%

rubric.jsonevals/scenario-8/

{
  "context": "This evaluation assesses how effectively the engineer uses the azure-batch package's task operations to list tasks within a job and retrieve detailed information about individual tasks.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Client initialization",
      "description": "Correctly initializes BatchServiceClient with appropriate credentials (SharedKeyCredentials or TokenCredential) and batch account URL",
      "max_score": 20
    },
    {
      "name": "Task listing usage",
      "description": "Uses the task.list() method to retrieve all tasks for the specified job ID, passing the job_id parameter correctly",
      "max_score": 30
    },
    {
      "name": "Task detail retrieval",
      "description": "Retrieves detailed task information either by using task.get() for individual tasks or by configuring the list operation to return complete task details (e.g., using expand or select parameters)",
      "max_score": 25
    },
    {
      "name": "Task property access",
      "description": "Correctly accesses task properties from returned CloudTask objects, including id, state, and execution_info (which contains exit_code, start_time, end_time)",
      "max_score": 15
    },
    {
      "name": "Empty list handling",
      "description": "Properly handles the case when a job has no tasks, displaying an appropriate message to the user",
      "max_score": 10
    }
  ]
}