CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

pubnub/pubnub-functions

Develop serverless edge functions with PubNub Functions 2.0

Agent Success

Agent success rate when using this tile

93%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.79x

Baseline

Agent success rate without this tile

52%

Overview
Eval results
Skill reviews
Files

rubric.jsonevals/scenario-5/

{
  "context": "Evaluates whether the agent correctly uses PubNub Functions KVStore with proper TTL units, atomic counter APIs, and vault-based secret management. Tests knowledge of KVStore-specific API design choices that differ from typical key-value stores.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "TTL in minutes",
      "description": "db.set() calls include a TTL parameter expressed in minutes (not seconds), e.g., 1440 for 24 hours or 60 for 1 hour",
      "max_score": 25
    },
    {
      "name": "incrCounter for counting",
      "description": "Counting operations use db.incrCounter(key) for atomic increments, not db.get()+db.set() with manual arithmetic",
      "max_score": 25
    },
    {
      "name": "getCounter to read",
      "description": "Counter values are read with db.getCounter(key), not db.get(key), since counters use a separate API",
      "max_score": 15
    },
    {
      "name": "Vault for secrets",
      "description": "API keys or credentials are retrieved from vault.get() rather than being hardcoded in the function code",
      "max_score": 20
    },
    {
      "name": "Vault null check",
      "description": "Code checks if vault.get() returns null (secret not configured) and handles the case with an error or fallback",
      "max_score": 15
    }
  ]
}
tessl i pubnub/pubnub-functions@0.1.4

evals

SKILL.md

tile.json