CtrlK
BlogDocsLog inGet started
Tessl Logo

pubnub/pubnub-chat

Build chat applications with PubNub Chat SDK

97

1.13x
Quality

72%

Does it follow best practices?

Impact

100%

1.13x

Average score across 20 eval scenarios

SecuritybySnyk

Risky

Do not use without reviewing

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-1/

{
  "context": "Evaluates whether the agent correctly initializes the PubNub Chat SDK using the specific async factory pattern and proper authentication configuration. Tests knowledge of Chat SDK-specific patterns that differ from the base PubNub SDK.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Import from @pubnub/chat",
      "description": "Chat class is imported from '@pubnub/chat' package, not from 'pubnub'",
      "max_score": 20
    },
    {
      "name": "Async Chat.init factory",
      "description": "Initialization uses await Chat.init({...}) async factory method, not a constructor (new Chat(...))",
      "max_score": 25
    },
    {
      "name": "authKey not token",
      "description": "Access Manager credentials are passed via 'authKey' parameter, not 'token' parameter",
      "max_score": 25
    },
    {
      "name": "Persistent userId",
      "description": "userId is provided as a required parameter and is described as persistent/unique per user, not randomly generated",
      "max_score": 15
    },
    {
      "name": "App Context mentioned",
      "description": "The solution mentions or notes that App Context must be enabled in the PubNub Admin Portal keyset settings",
      "max_score": 15
    }
  ]
}

evals

scenario-1

criteria.json

task.md

SKILL.md

tile.json