Develop serverless edge functions with PubNub Functions 2.0
Agent Success
Agent success rate when using this tile
93%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.79x
Baseline
Agent success rate without this tile
52%
{
"context": "Evaluates whether the agent correctly uses PubNub Functions KVStore with proper TTL units, atomic counter APIs, and vault-based secret management. Tests knowledge of KVStore-specific API design choices that differ from typical key-value stores.",
"type": "weighted_checklist",
"checklist": [
{
"name": "TTL in minutes",
"description": "db.set() calls include a TTL parameter expressed in minutes (not seconds), e.g., 1440 for 24 hours or 60 for 1 hour",
"max_score": 25
},
{
"name": "incrCounter for counting",
"description": "Counting operations use db.incrCounter(key) for atomic increments, not db.get()+db.set() with manual arithmetic",
"max_score": 25
},
{
"name": "getCounter to read",
"description": "Counter values are read with db.getCounter(key), not db.get(key), since counters use a separate API",
"max_score": 15
},
{
"name": "Vault for secrets",
"description": "API keys or credentials are retrieved from vault.get() rather than being hardcoded in the function code",
"max_score": 20
},
{
"name": "Vault null check",
"description": "Code checks if vault.get() returns null (secret not configured) and handles the case with an error or fallback",
"max_score": 15
}
]
}