Python library to build pretty command line user prompts with interactive forms and validation
96
Pending
Does it follow best practices?
Impact
96%
1.00xAverage score across 10 eval scenarios
Pending
The risk profile of this skill
{
"context": "This criteria evaluates the engineer's ability to use the questionary package for collecting user input, specifically focusing on the password input capability for masking sensitive data. The evaluation assesses correct usage of questionary.text() for plain text input and questionary.password() for secure masked input.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Import questionary",
"description": "The solution imports the questionary module or specific functions from it (e.g., 'import questionary' or 'from questionary import text, password').",
"max_score": 5
},
{
"name": "Use questionary.text()",
"description": "Uses questionary.text() to collect plain text input (username, database host) where masking is not required.",
"max_score": 15
},
{
"name": "Use questionary.password()",
"description": "Uses questionary.password() to collect sensitive input (passwords, API keys) with masked characters.",
"max_score": 40
},
{
"name": "Call .ask() method",
"description": "Properly invokes the .ask() method on questionary prompt objects to execute the prompts and retrieve user input.",
"max_score": 20
},
{
"name": "Multiple password prompts",
"description": "Successfully implements multiple password input prompts across different functions (user password, API key, database password) using questionary.password().",
"max_score": 15
},
{
"name": "Return correct data",
"description": "Returns the collected data in the correct format as specified (dictionaries with correct keys for credentials functions, string for API key function).",
"max_score": 5
}
]
}docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10