A Comparative Analysis of Machine-learning Models for Solar Flare Forecasting: Identifying High-performing Active Region Flare Indicators

Abstract

Solar flares create adverse space weather impacting space and Earth-based technologies. However, the difficulty of forecasting flares, and by extension severe space weather, is accentuated by the lack of any unique flare trigger or a single physical pathway. Studies indicate that multiple physical properties contribute to active region flare potential, compounding the challenge. Recent developments in machine learning (ML) have enabled analysis of higher-dimensional data leading to increasingly better flare forecasting techniques. However, consensus on high-performing flare predictors remains elusive. In the most comprehensive study to date, we conduct a comparative analysis of four popular ML techniques (k-nearest neighbor, logistic regression, random forest classifier, and support vector machine) by training these on magnetic parameters obtained from the Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamics Observatory (SDO) for the entirety of solar cycle 24. We demonstrate that the logistic regression and support vector machine algorithms perform extremely well in forecasting active region flaring potential. The logistic regression algorithm returns the highest true skill score of $0.967\pm 0.018$, possibly the highest classification performance achieved with any strictly parametric study. From a comparative assessment, we establish that the magnetic properties like total current helicity, total vertical current density, total unsigned flux, R_VALUE, and total absolute twist are the top-performing flare indicators. We also introduce and analyze two new performance metrics, namely, severe and clear space weather indicators. Our analysis constrains the most successful ML algorithms and identifies physical parameters that contribute most to active region flare productivity.

References in corpus (16)

• The Helioseismic and Magnetic Imager (HMI) Vector Magnetic Field Pipeline: SHARPs -- Space-weather HMI Active Region Patches
• Understanding space weather to shield society: A global road map for 2015-2025 commissioned by COSPAR and ILWS
• Solar Flare Prediction Using SDO/HMI Vector Magnetic Field Data with a Machine-Learning Algorithm
• Non-linear force-free field modeling of a solar active region around the time of a major flare and coronal mass ejection
• Toward Reliable Benchmarking of Solar Flare Forecasting Methods
• Solar Flare Prediction Model with Three Machine-Learning Algorithms Using Ultraviolet Brightening and Vector Magnetogram
• Predicting Solar Flares Using a Long Short-Term Memory Network
• Predicting Solar Flares Using SDO/HMI Vector Magnetic Data Product and Random Forest Algorithm
• What is the relationship between photospheric flow fields and solar flares?
• Prediction of Solar Flares Using Unique Signatures of Magnetic Field Images
• An automated classification approach to ranking photospheric proxies of magnetic energy build-up
• Reliable Probability Forecast of Solar Flares: Deep Flare Net-Reliable (DeFN-R)
• Supervised convolutional neural networks for classification of flaring and nonflaring active regions using line-of-sight magnetograms
• Solar Flares Forecasting Using Time Series and Extreme Gradient Boosting Ensembles
• Machine learning reveals systematic accumulation of electric current in lead-up to solar flares
• The Relationship between Solar Coronal X-Ray Brightness and Active Region Magnetic Fields: A Study Using High Resolution Hinode Observations