RIRW Verification

RIRW Verification: 2014 Model Forecasts

• The probability of detection (POD) and false alarm rate (FAR) are 7.3% and 66.4%, respectively for HWRF-14 forecasts. Relaxing the intensity and timing threshold for the model to 20 kt in 30-h improves the POD to 38.6% and has a FAR of 78.0%.

RI Contingency table: 30 kt in 24-h
OBS
Yes No
FCST Yes 128 253
No 1623 37654






• The distributions of the difference of change in a-deck values in the last 24-h and change in b-deck values in the last 24-h (ABDEL) are examined and for HWRF-14 forecasts. The hits (green boxes) are below the zero line, indicating that if the forecasts predicts a RI event, it under-estimates the magnitude of the intensity change.



Click for larger image.

• Similar boxplots of CTCX and OFCL show that both also under-estimates RI magnitude, even for hits. After 48-h, there are no OFCL RI forecasts.



Click for larger image.

• The 2014 HWRF model has difficulty predicting RI when the initial intensity is hurricane strength at the initial time.

• The 2014 HWRF model has higher POD (15.3%) and lower FAR (58.7%) for RW cases.

2014 HWRF RW Contingency table: H215 30 kt in 24-h
OBS
Yes No
FCST Yes 324 461
No 1793 37080








• The ABDEL boxplots for 2014 HWRF and CTCX models show that when the models detects RW, they predict the average intensity change. The OFCL tends to underestimate the reduction in intensity by 5 to 10 kt for hits.



Click for larger image.