tessl install tessl/pypi-questionary@2.1.0Python library to build pretty command line user prompts with interactive forms and validation
Agent Success
Agent success rate when using this tile
96%
Improvement
Agent success rate improvement when using this tile compared to baseline
1x
Baseline
Agent success rate without this tile
96%
{
"context": "This evaluation assesses how well the engineer uses questionary's confirm prompt functionality to create an interactive configuration tool. The focus is entirely on proper usage of questionary.confirm() with appropriate parameters like message text and default values.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses questionary.confirm()",
"description": "Implementation uses questionary.confirm() function to create yes/no confirmation prompts rather than implementing custom confirmation logic or using other prompt types.",
"max_score": 30
},
{
"name": "Three confirmation prompts",
"description": "Creates exactly three confirmation prompts with the specified question texts: one for automatic updates, one for backup creation, and one for deleting temporary files.",
"max_score": 20
},
{
"name": "Default value configuration",
"description": "Correctly configures default values for confirm prompts: the automatic updates prompt has no default (or default=None), the backup prompt defaults to True/Yes, and the delete temp files prompt defaults to False/No. Uses the 'default' parameter of questionary.confirm().",
"max_score": 25
},
{
"name": "Prompt execution",
"description": "Properly invokes the confirm prompts using .ask() or .ask_async() methods to get user responses, rather than just creating prompt objects without executing them.",
"max_score": 15
},
{
"name": "Return structure",
"description": "Returns a dictionary with the three specified keys ('auto_updates', 'create_backup', 'delete_temp_files') mapped to boolean values obtained from the confirm prompts.",
"max_score": 10
}
]
}