Explainable Deep Learning-based Solar Flare Prediction with post hoc Attention for Operational Forecasting

Abstract

This paper presents a post hoc analysis of a deep learning-based full-disk solar flare prediction model. We used hourly full-disk line-of-sight magnetogram images and selected binary prediction mode to predict the occurrence of $\ge$M1.0-class flares within 24 hours. We leveraged custom data augmentation and sample weighting to counter the inherent class-imbalance problem and used true skill statistic and Heidke skill score as evaluation metrics. Recent advancements in gradient-based attention methods allow us to interpret models by sending gradient signals to assign the burden of the decision on the input features. We interpret our model using three post hoc attention methods: (i) Guided Gradient-weighted Class Activation Mapping, (ii) Deep Shapley Additive Explanations, and (iii) Integrated Gradients. Our analysis shows that full-disk predictions of solar flares align with characteristics related to the active regions. The key findings of this study are: (1) We demonstrate that our full disk model can tangibly locate and predict near-limb solar flares, which is a critical feature for operational flare forecasting, (2) Our candidate model achieves an average TSS=0.51$\pm$0.05 and HSS=0.38$\pm$0.08, and (3) Our evaluation suggests that these models can learn conspicuous features corresponding to active regions from full-disk magnetograms.

arXiv comment15 pages, 5 figures. This is a preprint accepted at the 26th International Conference on Discovery Science (DS2023). arXiv admin note: text overlap with arXiv:2307.15878

References in corpus (13)

• Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networks
• An Observational Overview of Solar Flares
• The Helioseismic and Magnetic Imager (HMI) Vector Magnetic Field Pipeline: Overview and Performance
• Solar Flare Prediction Model with Three Machine-Learning Algorithms Using Ultraviolet Brightening and Vector Magnetogram
• Deep Flare Net (DeFN) model for solar flare prediction
• Robust Explainability: A Tutorial on Gradient-Based Attribution Methods for Deep Neural Networks
• Predicting Solar Flares Using CNN and LSTM on Two Solar Cycles of Active Region Data
• How to Train Your Flare Prediction Model: Revisiting Robust Sampling of Rare Events
• A new method to quantify and reduce projection error in whole-solar-active-region parameters measured from vector magnetograms
• Towards Coupling Full-disk and Active Region-based Flare Prediction for Operational Space Weather Forecasting
• Supervised convolutional neural networks for classification of flaring and nonflaring active regions using line-of-sight magnetograms
• All-Clear Flare Prediction Using Interval-based Time Series Classifiers
• Explaining Full-disk Deep Learning Model for Solar Flare Prediction using Attribution Methods

Cited by in corpus (1)

• Interpreting anomaly detection of SDSS spectra