ligolnik/flight-weather-watch
Aviation weather briefing tool that fetches WPC prog charts, QPF, and AWC products, overlays flight routes, and generates HTML briefings with Claude analysis.
45
90%
Does it follow best practices?
Impact
0%
0.00xAverage score across 6 eval scenarios
Advisory
Suggest reviewing before use
Evaluation results
0%
-60%Flight Weather Briefing Setup
Nashville as KMQY
100%
0%
Austin as KEDC
0%
0%
Cache flag included
0%
0%
Correct UTC time
100%
0%
Correct date format
100%
0%
Correct altitude format
100%
0%
TAS flag used
100%
0%
Correct argument order
100%
0%
0%
-45%Rebuild Briefing from Cache
from-cache flag with correct prefix
20%
0%
Nashville as KMQY
0%
0%
Austin as KEDC
0%
0%
All positional args present
66%
0%
TAS specified
100%
0%
No --cache flag
100%
0%
Explains no API calls
100%
0%
0%
-90%DST Timezone Edge Case
Correct UTC time after DST fallback
100%
0%
San Carlos as KSQL
100%
0%
Denver as KBJC
100%
0%
Correct date
100%
0%
Altitude and TAS correct
100%
0%
Cache flag included
0%
0%
DST reasoning explained
100%
0%
5%
-13%Error Recovery — Past Departure Time
Uses --from-cache flag
0%
0%
Correct cache prefix
0%
0%
Nashville as KMQY
0%
0%
Las Vegas as KVGT
0%
0%
All positional args present
0%
0%
TAS specified
100%
0%
Explains past-time bypass
53%
0%
Does not suggest changing the date
100%
100%
0%
-90%Multi-Leg Flight with Fuel Stop
Denver as KBJC
100%
0%
Tonopah as KTPH or correct ICAO
100%
0%
San Carlos as KSQL
100%
0%
Waypoint ordering
100%
0%
Correct UTC time
100%
0%
Cache flag included
0%
0%
TAS and altitude correct
100%
0%
Correct date
100%
0%
0%
-70%Return Flight Briefing
Origin is KBDN
100%
0%
Destination is KSQL
100%
0%
Correct UTC time
50%
0%
Same date
100%
0%
Same altitude
100%
0%
Same TAS
0%
0%
Cache flag included
0%
0%
Correct argument order
50%
0%
- Evaluated
- Agent
- Claude Code
- Model
- Claude Sonnet 4.6