Give AI agents their own email inboxes using the AgentMail API. Use when building email agents, sending/receiving emails programmatically, managing inboxes, handling attachments, organizing with labels, creating drafts for human approval, or setting up real-time notifications via webhooks/websockets. Supports multi-tenant isolation with pods.
95
93%
Does it follow best practices?
Impact
100%
1.07xAverage score across 4 eval scenarios
Advisory
Suggest reviewing before use
{
"context": "Tests whether the solver preserves the AgentMail API key contract while allowing only explicit AGENTMAIL_KEY alias mapping for a bounded read-only inbox census.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Prefers AGENTMAIL_API_KEY by default",
"description": "The script uses AGENTMAIL_API_KEY as the default credential source when present.",
"max_score": 15
},
{
"name": "No silent AGENTMAIL_KEY fallback",
"description": "The script does not automatically use AGENTMAIL_KEY unless an explicit opt-in flag is present.",
"max_score": 20
},
{
"name": "Explicit alias gate present",
"description": "The script requires --allow-agentmail-key-alias or equivalent explicit opt-in before mapping AGENTMAIL_KEY.",
"max_score": 15
},
{
"name": "Correct SDK import",
"description": "The script imports from agentmail and uses AgentMailClient.",
"max_score": 10
},
{
"name": "Exactly one read-only census call",
"description": "The script performs one client.inboxes.list() call and does not make create/send/delete/write calls.",
"max_score": 15
},
{
"name": "Truthful empty-account handling",
"description": "The script treats zero inboxes as a valid possible result rather than as an automatic error.",
"max_score": 10
},
{
"name": "Clear missing-credential failure",
"description": "The script fails clearly when neither AGENTMAIL_API_KEY nor an explicitly allowed alias path is available.",
"max_score": 10
},
{
"name": "Reports inbox count honestly",
"description": "The output includes a truthful inbox count instead of over-claiming mailbox contents.",
"max_score": 5
}
]
}