or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/azure-batch@14.2.x
tile.json

tessl/pypi-azure-batch

tessl install tessl/pypi-azure-batch@14.2.0

Microsoft Azure Batch Client Library for Python providing comprehensive APIs for managing batch computing workloads in Azure cloud

Agent Success

Agent success rate when using this tile

91%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.07x

Baseline

Agent success rate without this tile

85%

rubric.jsonevals/scenario-7/

{
  "context": "This criteria evaluates how well the engineer uses the azure-batch package to implement start tasks for node initialization in Azure Batch pools. The focus is on proper configuration of start tasks, including command execution, wait behavior, and user identity settings.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Client Authentication",
      "description": "Uses SharedKeyCredentials class with account name and key to create credentials, and BatchServiceClient with credentials and batch URL to create an authenticated client.",
      "max_score": 15
    },
    {
      "name": "StartTask Creation",
      "description": "Creates a models.StartTask object with the command_line property set to execute the shell command (apt-get update && apt-get install -y python3-pip).",
      "max_score": 15
    },
    {
      "name": "Wait for Success",
      "description": "Configures the StartTask with wait_for_success=True to ensure the start task completes successfully before the node accepts tasks.",
      "max_score": 20
    },
    {
      "name": "Elevated Privileges",
      "description": "Sets the user_identity property of the StartTask with models.UserIdentity and auto_user configured with elevation_level set to models.ElevationLevel.admin (or 'admin').",
      "max_score": 25
    },
    {
      "name": "VM Configuration",
      "description": "Configures virtual_machine_configuration property using models.VirtualMachineConfiguration with an appropriate image_reference for Ubuntu 20.04 LTS and a node_agent_sku_id.",
      "max_score": 10
    },
    {
      "name": "Pool Configuration",
      "description": "Creates a models.PoolAddParameter object with pool_id='analysis-pool', vm_size='STANDARD_D2_V2', target_dedicated_nodes=2, virtual_machine_configuration set to the VM config, and start_task property set to the configured StartTask object.",
      "max_score": 10
    },
    {
      "name": "Pool Creation",
      "description": "Calls the pool.add() method on the BatchServiceClient to create the pool with the configured start task.",
      "max_score": 5
    }
  ]
}