Python client library for Modal, a serverless cloud computing platform that enables developers to run Python code in the cloud with on-demand access to compute resources.
85
{
"context": "This criteria evaluates how well the engineer uses Modal's interactive debugging capabilities to implement a data validation tool with human-in-the-loop intervention. The focus is on proper usage of modal.interact() and the configuration required to enable interactive user input within remote cloud functions.",
"type": "weighted_checklist",
"checklist": [
{
"name": "modal.interact() usage",
"description": "Uses modal.interact() function to enable interactive user input within the remote function execution context when validation fails",
"max_score": 35
},
{
"name": "PTY mode enabled",
"description": "Configures the Modal function with pty=True parameter to enable pseudo-terminal support required for interactive input",
"max_score": 25
},
{
"name": "Remote function setup",
"description": "Creates a Modal app and defines a remote function using @app.function() decorator that handles the validation logic remotely",
"max_score": 15
},
{
"name": "Input/output handling",
"description": "Properly uses input() or similar mechanisms within the interact() context to capture user responses and process them appropriately",
"max_score": 15
},
{
"name": "Validation logic",
"description": "Implements the specified validation rules correctly (name format, age range, email format) and triggers interactive prompts only when validation fails",
"max_score": 10
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-modaldocs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10