CtrlK
BlogDocsLog inGet started
Tessl Logo

ligolnik/flight-weather-watch

Aviation weather briefing tool that fetches WPC prog charts, QPF, and AWC products, overlays flight routes, and generates HTML briefings with Claude analysis.

45

0.00x
Quality

90%

Does it follow best practices?

Impact

0%

0.00x

Average score across 6 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-5/

{
  "context": "Tests whether the agent correctly handles multi-leg flights with waypoints, resolves preferred airport codes, converts MDT to UTC, and includes all required flags.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Denver as KBJC",
      "description": "Uses KBJC as the origin airport code (Rocky Mountain Metropolitan, the user's preferred Denver airport)",
      "max_score": 15
    },
    {
      "name": "Tonopah as KTPH or correct ICAO",
      "description": "Resolves Tonopah, Nevada to KTPH (Tonopah Airport) and places it as a waypoint between origin and destination",
      "max_score": 15
    },
    {
      "name": "San Carlos as KSQL",
      "description": "Uses KSQL as the destination airport code (San Carlos Airport)",
      "max_score": 15
    },
    {
      "name": "Waypoint ordering",
      "description": "Command has KBJC KTPH KSQL in the correct positional order (origin, waypoint, destination)",
      "max_score": 15
    },
    {
      "name": "Correct UTC time",
      "description": "Departure time converted to 14:00 UTC (8 AM MDT = UTC-6, so 08:00 + 06:00 = 14:00)",
      "max_score": 15
    },
    {
      "name": "Cache flag included",
      "description": "Includes the --cache flag",
      "max_score": 10
    },
    {
      "name": "TAS and altitude correct",
      "description": "Includes --tas 170 and altitude 18000",
      "max_score": 10
    },
    {
      "name": "Correct date",
      "description": "Date is 2026-04-01 in YYYY-MM-DD format",
      "max_score": 5
    }
  ]
}

tile.json