CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

pubnub/pubnub-app-developer

Build real-time applications with PubNub pub/sub messaging

Agent Success

Agent success rate when using this tile

94%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.29x

Baseline

Agent success rate without this tile

73%

Overview
Eval results
Skill reviews
Files

rubric.jsonevals/scenario-5/

{
  "context": "Evaluates whether the agent correctly implements PubNub wildcard subscription patterns with proper dot-delimited hierarchy and understands the specific constraints on wildcard placement and depth. Tests PubNub-specific wildcard rules that differ from typical glob patterns.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Dot hierarchy delimiter",
      "description": "Channel names use dots (periods) as the hierarchy delimiter for wildcard-eligible channels (e.g., 'sensors.building1.temperature')",
      "max_score": 25
    },
    {
      "name": "Asterisk at end only",
      "description": "All wildcard subscribe patterns place the asterisk (*) only at the end of the pattern, never at the beginning or middle",
      "max_score": 25
    },
    {
      "name": "Max two dots",
      "description": "Channel hierarchy uses at most two dots (three levels), not exceeding the maximum depth allowed for wildcard subscriptions",
      "max_score": 20
    },
    {
      "name": "Stream Controller noted",
      "description": "The solution mentions or acknowledges that wildcard subscriptions require the Stream Controller add-on to be enabled",
      "max_score": 15
    },
    {
      "name": "Correct subscribe syntax",
      "description": "The wildcard subscribe call uses the correct PubNub syntax: pubnub.subscribe({ channels: ['prefix.*'] })",
      "max_score": 15
    }
  ]
}
tessl i pubnub/pubnub-app-developer@0.1.4

evals

SKILL.md

tile.json