CtrlK
BlogDocsLog inGet started
Tessl Logo

markusdowne/agentmail

Give AI agents their own email inboxes using the AgentMail API. Use when building email agents, sending/receiving emails programmatically, managing inboxes, handling attachments, organizing with labels, creating drafts for human approval, or setting up real-time notifications via webhooks/websockets. Supports multi-tenant isolation with pods.

95

1.07x
Quality

93%

Does it follow best practices?

Impact

100%

1.07x

Average score across 4 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-4/

{
  "context": "Tests whether the solver preserves the AgentMail API key contract while allowing only explicit AGENTMAIL_KEY alias mapping for a bounded read-only inbox census.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Prefers AGENTMAIL_API_KEY by default",
      "description": "The script uses AGENTMAIL_API_KEY as the default credential source when present.",
      "max_score": 15
    },
    {
      "name": "No silent AGENTMAIL_KEY fallback",
      "description": "The script does not automatically use AGENTMAIL_KEY unless an explicit opt-in flag is present.",
      "max_score": 20
    },
    {
      "name": "Explicit alias gate present",
      "description": "The script requires --allow-agentmail-key-alias or equivalent explicit opt-in before mapping AGENTMAIL_KEY.",
      "max_score": 15
    },
    {
      "name": "Correct SDK import",
      "description": "The script imports from agentmail and uses AgentMailClient.",
      "max_score": 10
    },
    {
      "name": "Exactly one read-only census call",
      "description": "The script performs one client.inboxes.list() call and does not make create/send/delete/write calls.",
      "max_score": 15
    },
    {
      "name": "Truthful empty-account handling",
      "description": "The script treats zero inboxes as a valid possible result rather than as an automatic error.",
      "max_score": 10
    },
    {
      "name": "Clear missing-credential failure",
      "description": "The script fails clearly when neither AGENTMAIL_API_KEY nor an explicitly allowed alias path is available.",
      "max_score": 10
    },
    {
      "name": "Reports inbox count honestly",
      "description": "The output includes a truthful inbox count instead of over-claiming mailbox contents.",
      "max_score": 5
    }
  ]
}

evals

SKILL.md

tile.json