Towards Coupling Full-disk and Active Region-based Flare Prediction for Operational Space Weather Forecasting

Abstract

Solar flare prediction is a central problem in space weather forecasting and has captivated the attention of a wide spectrum of researchers due to recent advances in both remote sensing as well as machine learning and deep learning approaches. The experimental findings based on both machine and deep learning models reveal significant performance improvements for task specific datasets. Along with building models, the practice of deploying such models to production environments under operational settings is a more complex and often time-consuming process which is often not addressed directly in research settings. We present a set of new heuristic approaches to train and deploy an operational solar flare prediction system for $\ge$M1.0-class flares with two prediction modes: full-disk and active region-based. In full-disk mode, predictions are performed on full-disk line-of-sight magnetograms using deep learning models whereas in active region-based models, predictions are issued for each active region individually using multivariate time series data instances. The outputs from individual active region forecasts and full-disk predictors are combined to a final full-disk prediction result with a meta-model. We utilized an equal weighted average ensemble of two base learners' flare probabilities as our baseline meta learner and improved the capabilities of our two base learners by training a logistic regression model. The major findings of this study are: (i) We successfully coupled two heterogeneous flare prediction models trained with different datasets and model architecture to predict a full-disk flare probability for next 24 hours, (ii) Our proposed ensembling model, i.e., logistic regression, improves on the predictive performance of two base learners and the baseline meta learner measured in terms of two widely used metrics True Skill Statistic (TSS) and Heidke Skill core (HSS), and (iii) Our result analysis suggests that the logistic regression-based ensemble (Meta-FP) improves on the full-disk model (base learner) by $\sim 9\%$ in terms TSS and $\sim 10\%$ in terms of HSS. Similarly, it improves on the AR-based model (base learner) by $\sim 17\%$ and $\sim 20\%$ in terms of TSS and HSS respectively. Finally, when compared to the baseline meta model, it improves on TSS by $\sim 10\%$ and HSS by $\sim 15\%$.

References in corpus (20)

• XGBoost: A Scalable Tree Boosting System
• The Helioseismic and Magnetic Imager (HMI) Vector Magnetic Field Pipeline: Overview and Performance
• Solar Flare Prediction Using SDO/HMI Vector Magnetic Field Data with a Machine-Learning Algorithm
• Flare-productive active regions
• Solar Flare Prediction Model with Three Machine-Learning Algorithms Using Ultraviolet Brightening and Vector Magnetogram
• Forecasting Solar Flares Using Magnetogram-based Predictors and Machine Learning
• Deep Flare Net (DeFN) model for solar flare prediction
• Predicting Solar Flares Using SDO/HMI Vector Magnetic Data Product and Random Forest Algorithm
• Flare Prediction Using Photospheric and Coronal Image Data
• Solar Magnetic Feature Detection and Tracking for Space Weather Monitoring
• A hybrid supervised/unsupervised machine learning approach to solar flare prediction
• How to Train Your Flare Prediction Model: Revisiting Robust Sampling of Rare Events
• The importance of ensemble techniques for operational space weather forecasting
• Feature ranking of active region source properties in solar flare forecasting and the uncompromised stochasticity of flare occurrence
• Ensemble Forecasting of Major Solar Flares -- First Results
• Operational solar flare prediction model using Deep Flare Net
• All-Clear Flare Prediction Using Interval-based Time Series Classifiers
• A Framework for Designing and Evaluating Solar Flare Forecasting Systems
• DeepSun: Machine-Learning-as-a-Service for Solar Flare Prediction
• Ensemble Forecasting of Major Solar Flares: Methods for Combining Models

Cited by in corpus (4)

• Explaining Full-disk Deep Learning Model for Solar Flare Prediction using Attribution Methods
• Explainable Deep Learning-based Solar Flare Prediction with post hoc Attention for Operational Forecasting
• Solar Flare Prediction Using Long Short-term Memory (LSTM) and Decomposition-LSTM with Sliding Window Pattern Recognition
• Towards Hybrid Embedded Feature Selection and Classification Approach with Slim-TSF