CtrlK
BlogDocsLog inGet started
Tessl Logo

ligolnik/flight-weather-watch

Aviation weather briefing tool that fetches WPC prog charts, QPF, and AWC products, overlays flight routes, and generates HTML briefings with Claude analysis.

45

0.00x
Quality

90%

Does it follow best practices?

Impact

0%

0.00x

Average score across 6 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-2/

{
  "context": "Tests whether the agent correctly constructs a --from-cache command with the right cache prefix, preferred airport codes, and all required positional arguments.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "from-cache flag with correct prefix",
      "description": "Uses --from-cache cache_KMQY_KEDC_2026-03-16 (the correct prefix without _charts.json or _llm.json suffix)",
      "max_score": 25
    },
    {
      "name": "Nashville as KMQY",
      "description": "Uses KMQY as the origin airport code",
      "max_score": 15
    },
    {
      "name": "Austin as KEDC",
      "description": "Uses KEDC as the destination airport code",
      "max_score": 15
    },
    {
      "name": "All positional args present",
      "description": "Includes all positional arguments (KMQY KEDC 2026-03-16 15:00 12000) even though rebuilding from cache",
      "max_score": 15
    },
    {
      "name": "TAS specified",
      "description": "Includes --tas 170",
      "max_score": 10
    },
    {
      "name": "No --cache flag",
      "description": "Does not include --cache (unnecessary when rebuilding from existing cache)",
      "max_score": 10
    },
    {
      "name": "Explains no API calls",
      "description": "Explanation mentions that --from-cache bypasses fetching and API calls",
      "max_score": 10
    }
  ]
}

tile.json