or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/azure-batch@14.2.x
tile.json

tessl/pypi-azure-batch

tessl install tessl/pypi-azure-batch@14.2.0

Microsoft Azure Batch Client Library for Python providing comprehensive APIs for managing batch computing workloads in Azure cloud

Agent Success

Agent success rate when using this tile

91%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.07x

Baseline

Agent success rate without this tile

85%

rubric.jsonevals/scenario-3/

{
  "context": "This criteria evaluates how well an engineer uses the azure-batch package's task management APIs, specifically focusing on task creation, bulk operations, retrieval, listing, and deletion capabilities. The evaluation assesses proper use of TaskSpecification, EnvironmentSetting, TaskAddCollectionParameter, and the task operations client methods.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "TaskSpecification Usage",
      "description": "Uses azure.batch.models.TaskSpecification to create task objects with id, command_line, and display_name properties for basic task creation",
      "max_score": 20
    },
    {
      "name": "task.add Method",
      "description": "Correctly calls client.task.add(job_id, task) method to add individual tasks to a job",
      "max_score": 15
    },
    {
      "name": "EnvironmentSetting Configuration",
      "description": "Uses azure.batch.models.EnvironmentSetting to create environment variables and assigns them to TaskSpecification.environment_settings as a list",
      "max_score": 15
    },
    {
      "name": "Bulk Task Addition",
      "description": "Uses TaskAddCollectionParameter with a list of TaskSpecification objects and calls client.task.add_collection(job_id, task_collection) for bulk operations",
      "max_score": 20
    },
    {
      "name": "Task Retrieval",
      "description": "Correctly uses client.task.get(job_id, task_id) to retrieve specific task information",
      "max_score": 10
    },
    {
      "name": "Task Listing",
      "description": "Uses client.task.list(job_id) to retrieve all tasks in a job and properly handles the returned iterable",
      "max_score": 10
    },
    {
      "name": "Task Deletion",
      "description": "Correctly calls client.task.delete(job_id, task_id) to remove tasks from a job",
      "max_score": 10
    }
  ]
}