Verification of the NOAA Space Weather Prediction Center solar flare forecast (1998-2024)

Abstract

The NOAA Space Weather Prediction Center (SWPC) issues the official U.S. government forecast for M-class and X-class solar flares, yet the skill of these forecasts has never been comprehensively verified. In this study, we evaluate the SWPC probabilistic flare forecasts over a 26-year period (1998-2024), comparing them to several zero-cost and statistical baselines including persistence, climatology, Naive Bayes, and logistic regression. We find that the SWPC model does not outperform these baselines across key classification and probabilistic metrics and exhibits severe calibration issues and high false alarm rates, especially in high-stakes scenarios such as detecting the first flare after extended quiet periods. These findings demonstrate the need for more accurate and reliable eruption forecasting models which we suggest should be based on modern data-driven methods. The findings also provide a standard against which any proposed eruption prediction system should be compared. We suggest that space weather forecasters regularly update and publish analyses like the one demonstrated here to provide up-to-date standards of accuracy and reliability against which to compare new methods.

Under review in AGU Space Weather

References in corpus (4)

• Understanding space weather to shield society: A global road map for 2015-2025 commissioned by COSPAR and ILWS
• All-Clear Flare Prediction Using Interval-based Time Series Classifiers
• Decreasing False Alarm Rates in ML-based Solar Flare Prediction using SDO/HMI Data
• CLEAR Space Weather Center of Excellence: All-Clear Solar Energetic Particle Prediction