A Comparative Analysis of Machine-learning Models for Solar Flare Forecasting: Identifying High-performing Active Region Flare Indicators

Abstract

Solar flares create adverse space weather impacting space and Earth-based technologies. However, the difficulty of forecasting flares, and by extension severe space weather, is accentuated by the lack of any unique flare trigger or a single physical pathway. Studies indicate that multiple physical properties contribute to active region flare potential, compounding the challenge. Recent developments in machine learning (ML) have enabled analysis of higher-dimensional data leading to increasingly better flare forecasting techniques. However, consensus on high-performing flare predictors remains elusive. In the most comprehensive study to date, we conduct a comparative analysis of four popular ML techniques (k-nearest neighbor, logistic regression, random forest classifier, and support vector machine) by training these on magnetic parameters obtained from the Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamics Observatory (SDO) for the entirety of solar cycle 24. We demonstrate that the logistic regression and support vector machine algorithms perform extremely well in forecasting active region flaring potential. The logistic regression algorithm returns the highest true skill score of $0.967\pm 0.018$, possibly the highest classification performance achieved with any strictly parametric study. From a comparative assessment, we establish that the magnetic properties like total current helicity, total vertical current density, total unsigned flux, R_VALUE, and total absolute twist are the top-performing flare indicators. We also introduce and analyze two new performance metrics, namely, severe and clear space weather indicators. Our analysis constrains the most successful ML algorithms and identifies physical parameters that contribute most to active region flare productivity.

References in corpus (34)

• A high-bias, low-variance introduction to Machine Learning for physicists
• The Helioseismic and Magnetic Imager (HMI) Vector Magnetic Field Pipeline: SHARPs -- Space-weather HMI Active Region Patches
• Understanding space weather to shield society: A global road map for 2015-2025 commissioned by COSPAR and ILWS
• Solar Flare Prediction Using SDO/HMI Vector Magnetic Field Data with a Machine-Learning Algorithm
• Non-linear force-free field modeling of a solar active region around the time of a major flare and coronal mass ejection
• Toward Reliable Benchmarking of Solar Flare Forecasting Methods
• Prediction of the strength and timing of sunspot cycle 25 reveal decadal-scale space environmental conditions
• Solar Flare Prediction Model with Three Machine-Learning Algorithms Using Ultraviolet Brightening and Vector Magnetogram
• Forecasting Solar Flares Using Magnetogram-based Predictors and Machine Learning
• Deep Flare Net (DeFN) model for solar flare prediction
• Progress in Solar Cycle Predictions: Sunspot Cycles 24-25 in Perspective
• Predicting Solar Flares Using a Long Short-Term Memory Network
• Predicting Solar Flares Using SDO/HMI Vector Magnetic Data Product and Random Forest Algorithm
• Identifying Solar Flare Precursors Using Time Series of SDO/HMI Images and SHARP Parameters
• Flare Prediction Using Photospheric and Coronal Image Data
• What is the relationship between photospheric flow fields and solar flares?
• A hybrid supervised/unsupervised machine learning approach to solar flare prediction
• How to Train Your Flare Prediction Model: Revisiting Robust Sampling of Rare Events
• Feature ranking of active region source properties in solar flare forecasting and the uncompromised stochasticity of flare occurrence
• Solar Flare Intensity Prediction with Machine Learning Models
• Prediction of Solar Flares Using Unique Signatures of Magnetic Field Images
• UFCORIN: A Fully Automated Predictor of Solar Flares in GOES X-Ray Flux
• Prediction of Solar Flare Size and Time-to-Flare Using Support Vector Machine Regression
• An automated classification approach to ranking photospheric proxies of magnetic energy build-up
• Relationships Between Characteristics of the Line-of-Sight Magnetic Field and Solar Flare Forecasts
• Dependence of coronal mass ejection properties on their solar source active region characteristics and associated flare reconnection flux
• Comparison of a Global Magnetic Evolution Model with Observations of Coronal Mass Ejections
• Reliable Probability Forecast of Solar Flares: Deep Flare Net-Reliable (DeFN-R)
• Supervised convolutional neural networks for classification of flaring and nonflaring active regions using line-of-sight magnetograms
• Distinguishing between Flaring and Non-Flaring Active Regions: A Machine Learning Perspective
• Solar Flares Forecasting Using Time Series and Extreme Gradient Boosting Ensembles
• A Sun-to-Earth analysis of magnetic helicity of the 17-18 March 2013 interplanetary coronal mass ejection
• Machine learning reveals systematic accumulation of electric current in lead-up to solar flares
• The Relationship between Solar Coronal X-Ray Brightness and Active Region Magnetic Fields: A Study Using High Resolution Hinode Observations