Forecasting Solar Flares Using Magnetogram-based Predictors and Machine Learning

Abstract

We propose a forecasting approach for solar flares based on data from Solar Cycle 24, taken by the Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamics Observatory (SDO) mission. In particular, we use the Space-weather HMI Active Region Patches (SHARP) product that facilitates cut-out magnetograms of solar active regions (AR) in the Sun in near-real-time (NRT), taken over a five-year interval (2012 - 2016). Our approach utilizes a set of thirteen predictors, which are not included in the SHARP metadata, extracted from line-of-sight and vector photospheric magnetograms. We exploit several Machine Learning (ML) and Conventional Statistics techniques to predict flares of peak magnitude >M1 and >C1, within a 24 h forecast window. The ML methods used are multi-layer perceptrons (MLP), support vector machines (SVM) and random forests (RF). We conclude that random forests could be the prediction technique of choice for our sample, with the second best method being multi-layer perceptrons, subject to an entropy objective function. A Monte Carlo simulation showed that the best performing method gives accuracy ACC=0.93(0.00), true skill statistic TSS=0.74(0.02) and Heidke skill score HSS=0.49(0.01) for >M1 flare prediction with probability threshold 15% and ACC=0.84(0.00), TSS=0.60(0.01) and HSS=0.59(0.01) for >C1 flare prediction with probability threshold 35%.

arXiv commentAccepted for publication by Solar Physics

References in corpus (12)

• Torus instability
• An Observational Overview of Solar Flares
• The Helioseismic and Magnetic Imager (HMI) Vector Magnetic Field Pipeline: SHARPs -- Space-weather HMI Active Region Patches
• Solar Flare Prediction Using SDO/HMI Vector Magnetic Field Data with a Machine-Learning Algorithm
• Toward Reliable Benchmarking of Solar Flare Forecasting Methods
• Critical decay index at the onset of solar eruptions
• Predicting Solar Flares Using SDO/HMI Vector Magnetic Data Product and Random Forest Algorithm
• Prediction of Solar Flare Size and Time-to-Flare Using Support Vector Machine Regression
• An automated classification approach to ranking photospheric proxies of magnetic energy build-up
• Buildup of Magnetic Shear and Free Energy During Flux Emergence and Cancellation
• The Overlooked Potential of Generalized Linear Models in Astronomy - I: Binomial Regression
• Spatio-temporal scaling of turbulent photospheric line-of-sight magnetic field in active region NOAA 11158

Cited by in corpus (54)

• The Challenge of Machine Learning in Space Weather Nowcasting and Forecasting
• Predicting Solar Flares Using a Long Short-Term Memory Network
• Surveying the reach and maturity of machine learning and artificial intelligence in astronomy
• A Comparison of Flare Forecasting Methods. II. Benchmarks, Metrics and Performance Results for Operational Solar Flare Forecasting Systems
• Identifying Solar Flare Precursors Using Time Series of SDO/HMI Images and SHARP Parameters
• Predicting Solar Flares Using CNN and LSTM on Two Solar Cycles of Active Region Data
• How to Train Your Flare Prediction Model: Revisiting Robust Sampling of Rare Events
• Predicting solar flares with machine learning: investigating solar cycle dependence
• Feature ranking of active region source properties in solar flare forecasting and the uncompromised stochasticity of flare occurrence
• Solar Flare Intensity Prediction with Machine Learning Models
• Using Machine Learning Methods to Forecast If Solar Flares Will Be Associated with CMEs and SEPs
• Fast Solar Image Classification Using Deep Learning and its Importance for Automation in Solar Physics
• Real-time flare prediction based on distinctions between flaring and non-flaring active region spectra
• Predicting Coronal Mass Ejections Using SDO/HMI Vector Magnetic Data Products and Recurrent Neural Networks
• Solar Flare Prediction Using Magnetic Field Diagnostics Above the Photosphere
• Implementation paradigm for supervised flare forecasting studies: a deep learning application with video data
• Towards Coupling Full-disk and Active Region-based Flare Prediction for Operational Space Weather Forecasting
• Fine-grained Solar Flare Forecasting Based on the Hybrid Convolutional Neural Networks
• Which Photospheric Characteristics are Most Relevant to Active-Region Coronal Mass Ejections?
• Reliable Probability Forecast of Solar Flares: Deep Flare Net-Reliable (DeFN-R)
• Testing and Improving a Set of Morphological Predictors of Flaring Activity
• Machine Learning applied to asteroid dynamics
• Flare Forecasting Algorithms Based on High-Gradient Polarity Inversion Lines in Active Regions
• All-Clear Flare Prediction Using Interval-based Time Series Classifiers
• Decreasing False Alarm Rates in ML-based Solar Flare Prediction using SDO/HMI Data
• The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC): Selection of a performance metric for classification probabilities balancing diverse science goals
• Non-LTE inversions of a confined X2.2 flare: I. Vector magnetic field in the photosphere and chromosphere
• Identifying preflare spectral features using explainable artificial intelligence
• Solar Flare Index Prediction Using SDO/HMI Vector Magnetic Data Products with Statistical and Machine Learning Methods
• Machine Learning Approaches to Solar-Flare Forecasting: Is Complex Better?
• Identification of BASS DR3 Sources as Stars, Galaxies and Quasars by XGBoost
• Leveraging the Mathematics of Shape for Solar Magnetic Eruption Prediction
• Distinguishing between Flaring and Non-Flaring Active Regions: A Machine Learning Perspective
• Real-Time Value-Driven Data Augmentation in the Era of LSST
• The characteristics of flare- and CME-productive solar active regions
• Differences in periodic magnetic helicity injection behaviour between flaring and non-flaring Active Regions: Case Study
• Science through Machine Learning: Quantification of Poststorm Thermospheric Cooling
• Unsupervised classification of simulated magnetospheric regions
• Solar Active Region Magnetogram Image Dataset for Studies of Space Weather
• Predicting Solar Energetic Particles Using SDO/HMI Vector Magnetic Data Products and a Bidirectional LSTM Network
• Machine learning reveals systematic accumulation of electric current in lead-up to solar flares
• Machine learning as a flaring storm warning machine: Was a warning machine for the September 2017 solar flaring storm possible?
• A Prospective New Diagnostic Technique for Distinguishing Eruptive and Non-Eruptive Active Regions
• On the differences in the periodic behaviour of magnetic helicity flux in flaring active regions with and without X-class events
• Spectropolarimetric Inversion in Four Dimensions with Deep Learning (SPIn4D): I. Overview, Magnetohydrodynamic Modeling, and Stokes Profile Synthesis
• A New Space Weather Tool for Identifying Eruptive Active Regions
• Segmentation of spectroscopic images of the low solar atmosphere by the Self Organizing Map technique
• Using Multiple Instance Learning for Explainable Solar Flare Prediction
• Solar Flare Prediction Using Long Short-term Memory (LSTM) and Decomposition-LSTM with Sliding Window Pattern Recognition
• Solar activity classification based on Mg II spectra: towards classification on compressed data
• A Comparative Analysis of Machine-learning Models for Solar Flare Forecasting: Identifying High-performing Active Region Flare Indicators
• ALEXIS: Recreating the X-Ray Emission from the Full Solar Disk as a Linear Combination of Discrete Regions in the Extreme Ultraviolet and Soft X-Rays
• Power-law Indices of EUV Intensity Power Spectrum in Flaring Coronal Active Regions
• Solar flare forecasting using morphological properties of sunspot groups