CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-gntp

tessl install tessl/pypi-gntp@1.0.0

Growl Notification Transport Protocol for Python

Agent Success

Agent success rate when using this tile

80%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.25x

Baseline

Agent success rate without this tile

64%

rubric.jsonevals/scenario-6/

{
  "context": "This criteria evaluates an engineer's proficiency in using the gntp package's parse_gntp() function to parse and extract information from various GNTP protocol messages. The focus is on correct usage of the low-level protocol parsing API.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "parse_gntp() usage",
      "description": "Uses gntp.core.parse_gntp() function to parse raw GNTP message data instead of manually parsing or using other approaches",
      "max_score": 25
    },
    {
      "name": "Message type detection",
      "description": "Correctly identifies and handles different message types returned by parse_gntp(): GNTPRegister, GNTPNotice, GNTPOK, and GNTPError using isinstance() or similar type checking",
      "max_score": 20
    },
    {
      "name": "Header access",
      "description": "Correctly accesses message headers using the .headers dictionary attribute on parsed message objects to extract Application-Name, Notification-Name, Notification-Title, Error-Code, and Error-Description",
      "max_score": 20
    },
    {
      "name": "Notification count extraction",
      "description": "Correctly accesses the .notifications list attribute on GNTPRegister objects and uses len() or similar to count notification types",
      "max_score": 10
    },
    {
      "name": "Error response handling",
      "description": "Uses the .error() method on GNTPError objects to extract error code and description as a tuple, rather than accessing headers directly",
      "max_score": 10
    },
    {
      "name": "Password authentication",
      "description": "Passes the password parameter to parse_gntp() when handling password-protected messages (e.g., parse_gntp(data, password='...'))",
      "max_score": 10
    },
    {
      "name": "gntp.core module import",
      "description": "Imports parse_gntp and message type classes from gntp.core module (e.g., from gntp.core import parse_gntp, GNTPOK, GNTPError, GNTPRegister, GNTPNotice)",
      "max_score": 5
    }
  ]
}

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/gntp@1.0.x
tile.json