Interpretation of Probabilistic Surface Ozone Forecasts: A Case Study for Philadelphia

Date

2023-09-19

Department

Program

Citation of Original Publication

Balashov, Nikolay V., Amy K. Huff, and Anne M. Thompson. "Interpretation of Probabilistic Surface Ozone Forecasts: A Case Study for Philadelphia", Weather and Forecasting 38, no. 10. (September 19, 2023). https://doi.org/10.1175/WAF-D-22-0185.1.

Rights

© Copyright 2025 American Meteorological Society (AMS). For permission to reuse any portion of this work, please contact permissions@ametsoc.org. Any use of material in this work that is determined to be “fair use” under Section 107 of the U.S. Copyright Act (17 U.S. Code §?107) or that satisfies the conditions specified in Section 108 of the U.S. Copyright Act (17 USC § 108) does not require the AMS’s permission. Republication, systematic reproduction, posting in electronic form, such as on a website or in a searchable database, or other uses of this material, except as exempted by the above statement, requires written permission or a license from the AMS. All AMS journals and monograph publications are registered with the Copyright Clearance Center (https://www.copyright.com). Additional details are provided in the AMS Copyright Policy statement, available on the AMS website (https://www.ametsoc.org/PUBSCopyrightPolicy).

Abstract

The use of probabilistic forecasting has been growing in a variety of disciplines because of its potential to emphasize the degree of uncertainty inherent in a prediction. Interpretation of probabilistic forecasts, however, is oftentimes difficult, deterring users who may benefit from such forecasts. To encourage broader use of probabilistic forecasts in the field of air quality, a process for interpreting forecasts from a statistical probabilistic air quality surface ozone model [the Regression in Self Organizing Map (REGiS)] is demonstrated. Four procedures to convert probabilistic to deterministic forecasts are explored for the Philadelphia, Pennsylvania, metropolitan area. These procedures calibrate the predicted probability of daily maximum 8-h-average ozone exceeding a standard value by 1) estimating climatological relative frequency, 2) establishing a probability of an exceedance threshold as 50%, 3) maximizing the threat score, and 4) determining the unit bias ratio. REGiS is trained using 2000–11 ozone-season (1 May–30 September) data, calibrated using 2012–14 data, and evaluated using 2015–18 data. Assessment of the calibration data with the Pierce skill score suggests an exceedance threshold based on climatological relative frequency for the conversion from probabilistic to deterministic forecasts. Calibrated REGiS generally compares well to predictions from the U.S. national air quality model and operational “expert” forecasts over the evaluation period. For other probabilistic models and situations, different procedures of converting probabilistic to deterministic forecasts may be more beneficial. The methods presented in this paper represent an approach for operational air quality forecasters seeking to use probabilistic model output to support forecasts designed to protect public health.