CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

pubnub/pubnub-app-developer

Build real-time applications with PubNub pub/sub messaging

Agent Success

Agent success rate when using this tile

94%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.29x

Baseline

Agent success rate without this tile

73%

Overview
Eval results
Skill reviews
Files

rubric.jsonevals/scenario-1/

{
  "context": "Evaluates whether the agent correctly initializes the PubNub JavaScript SDK with proper userId persistence, security constraints, and recommended configuration options. Tests knowledge of PubNub-specific initialization requirements that differ from generic messaging SDKs.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Persistent userId",
      "description": "userId is generated once and persisted (e.g., stored in localStorage or derived from authenticated user), not regenerated randomly each session",
      "max_score": 25
    },
    {
      "name": "No secret key client-side",
      "description": "Only publishKey, subscribeKey, and userId are included in the client-side PubNub constructor; no secretKey is present",
      "max_score": 20
    },
    {
      "name": "Single instance",
      "description": "A single PubNub instance is created and reused across the application, not instantiated multiple times",
      "max_score": 15
    },
    {
      "name": "enableEventEngine set",
      "description": "The enableEventEngine option is set to true in the PubNub configuration",
      "max_score": 15
    },
    {
      "name": "userId max 64 chars",
      "description": "The userId value is 64 characters or fewer, and is non-empty and non-undefined",
      "max_score": 10
    },
    {
      "name": "TLS not disabled",
      "description": "The ssl option is either omitted (defaulting to true) or explicitly set to true; it is not set to false",
      "max_score": 15
    }
  ]
}
tessl i pubnub/pubnub-app-developer@0.1.4

evals

scenario-1

rubric.json

task.md

SKILL.md

tile.json