Build real-time applications with PubNub pub/sub messaging
Agent Success
Agent success rate when using this tile
94%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.29x
Baseline
Agent success rate without this tile
73%
{
"context": "Evaluates whether the agent correctly initializes the PubNub JavaScript SDK with proper userId persistence, security constraints, and recommended configuration options. Tests knowledge of PubNub-specific initialization requirements that differ from generic messaging SDKs.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Persistent userId",
"description": "userId is generated once and persisted (e.g., stored in localStorage or derived from authenticated user), not regenerated randomly each session",
"max_score": 25
},
{
"name": "No secret key client-side",
"description": "Only publishKey, subscribeKey, and userId are included in the client-side PubNub constructor; no secretKey is present",
"max_score": 20
},
{
"name": "Single instance",
"description": "A single PubNub instance is created and reused across the application, not instantiated multiple times",
"max_score": 15
},
{
"name": "enableEventEngine set",
"description": "The enableEventEngine option is set to true in the PubNub configuration",
"max_score": 15
},
{
"name": "userId max 64 chars",
"description": "The userId value is 64 characters or fewer, and is non-empty and non-undefined",
"max_score": 10
},
{
"name": "TLS not disabled",
"description": "The ssl option is either omitted (defaulting to true) or explicitly set to true; it is not set to false",
"max_score": 15
}
]
}