CtrlK
BlogDocsLog inGet started
Tessl Logo

jbaruch/frequent-flyer-advocate

Write professional, persuasive complaint letters to US airlines emphasizing loyalty status, DOT regulations, and airline commitments.

93

1.38x
Quality

94%

Does it follow best practices?

Impact

93%

1.38x

Average score across 10 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-8/

{
  "context": "Tests whether the skill uses complaint history appropriately — referencing the genuine pattern (DFW-MIA same-route cancellation recurrence + prior DENIED) while not forcing the unrelated DFW-ORD delay into the narrative. Also tests that pattern references use matter-of-fact tone per the complaint-patterns rule.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Prior DFW-MIA cancellation referenced",
      "description": "The letter references the prior AA923 DFW-MIA cancellation from November 2025 as evidence of a recurring problem — same route, same category, same airline",
      "max_score": 18
    },
    {
      "name": "Prior DENIED resolution cited",
      "description": "The letter mentions that the prior cancellation complaint was denied or inadequately resolved (the $100 voucher offer), using this as escalation leverage",
      "max_score": 15
    },
    {
      "name": "DFW-ORD delay NOT forced into narrative",
      "description": "The letter does NOT reference the DFW-ORD delay as part of the cancellation pattern — it is a different category (delay vs cancellation) on a different route. If mentioned at all, it is not presented as part of the same pattern",
      "max_score": 15
    },
    {
      "name": "Pattern stated matter-of-fact",
      "description": "The complaint history reference uses factual, measured tone — e.g., 'This is the second cancellation on this route in four months' rather than emotional language like 'I cannot believe this keeps happening'",
      "max_score": 12
    },
    {
      "name": "Pattern in opening or airline-vs-reality section",
      "description": "The complaint history reference appears in the opening (loyalty despite adversity) or the airline's-own-words-vs-reality section — NOT in the regulatory or remedy sections",
      "max_score": 10
    },
    {
      "name": "Loyalty opening present",
      "description": "The letter opens with Lisa's Executive Platinum status, 6 years, and/or 1.8M miles before describing the incident",
      "max_score": 10
    },
    {
      "name": "Compensation calibrated to pattern",
      "description": "The requested compensation reflects the escalated situation — higher than what was requested for the first cancellation, given that it was denied and the issue recurred",
      "max_score": 10
    },
    {
      "name": "Complaint bank consulted",
      "description": "The letter or process documentation shows that the complaint bank was checked (complaints-bank.py check) for Lisa Park / AA before writing",
      "max_score": 10
    }
  ]
}

evals

tile.json