Python client library for Modal, a serverless cloud computing platform that enables developers to run Python code in the cloud with on-demand access to compute resources.
85
{
"context": "This criteria evaluates how well the engineer uses Modal's execution context functions (is_local, current_function_call_id, current_input_id) to detect and log execution environment information. The focus is on correct usage of these specific Modal API functions to distinguish between local and remote execution contexts.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses is_local()",
"description": "Correctly imports and calls modal.is_local() to determine whether code is running in a local or remote execution context.",
"max_score": 25
},
{
"name": "Uses current_function_call_id()",
"description": "Correctly imports and calls modal.current_function_call_id() to retrieve the function call identifier when executing remotely.",
"max_score": 20
},
{
"name": "Uses current_input_id()",
"description": "Correctly imports and calls modal.current_input_id() to retrieve the input identifier when executing remotely.",
"max_score": 20
},
{
"name": "Modal App setup",
"description": "Properly creates a modal.App instance and uses @app.function() decorator to define a serverless function.",
"max_score": 15
},
{
"name": "Local entrypoint usage",
"description": "Correctly uses @app.local_entrypoint() decorator to define the main entry point that orchestrates local and remote execution.",
"max_score": 10
},
{
"name": "Remote function invocation",
"description": "Properly invokes the Modal function remotely using .remote() method to demonstrate remote execution context.",
"max_score": 10
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-modaldocs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10