CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

pubnub/pubnub-live-auctions

Build real-time auction platforms with PubNub bidding and countdowns

Agent Success

Agent success rate when using this tile

100%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.18x

Baseline

Agent success rate without this tile

85%

Overview
Eval results
Skill reviews
Files

rubric.jsonevals/scenario-4/

{
  "context": "A developer needs to implement price-dependent bid increment rules and a reserve price system for a PubNub auction platform. The increment rules should prevent trivial bid increases at higher price points, and the reserve price must remain hidden from clients.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Tiered increment function",
      "description": "Implements a function that returns different minimum bid increments based on the current price level (not a single fixed increment)",
      "max_score": 15
    },
    {
      "name": "Six price tiers",
      "description": "Defines at least 5 distinct price tiers with increasing increment amounts (e.g., $1 under $100, $5 for $100-499, $10 for $500-999, $25 for $1000-4999, $50 for $5000-24999, $100 for $25000+)",
      "max_score": 15
    },
    {
      "name": "Server-side enforcement",
      "description": "The tiered increment check is performed inside a PubNub Function (server-side), not only on the client",
      "max_score": 10
    },
    {
      "name": "Reserve in KV Store only",
      "description": "The reserve price value is stored in KV Store server-side and is never included in messages sent to clients",
      "max_score": 15
    },
    {
      "name": "Reserve met event",
      "description": "When a bid meets or exceeds the reserve price for the first time, a 'reserve_met' message is published to the auction channel",
      "max_score": 15
    },
    {
      "name": "Reserve status tracking",
      "description": "A reserveMet boolean is tracked on the auction state and updated when the threshold is crossed",
      "max_score": 10
    },
    {
      "name": "Change detection",
      "description": "The reserve_met event is only published when the status changes from not-met to met (not on every bid that exceeds the reserve)",
      "max_score": 10
    },
    {
      "name": "End result includes reserve",
      "description": "The auction_ended message includes a reserveMet boolean so downstream logic can determine if the sale is valid",
      "max_score": 10
    }
  ]
}

evals

SKILL.mdtile.json