The Flare Likelihood and Region Eruption Forecasting (FLARECAST) Project: Flare forecasting in the big data & machine learning era
arXiv:2105.05993
Abstract
The EU funded the FLARECAST project, that ran from Jan 2015 until Feb 2018. FLARECAST had a R2O focus, and introduced several innovations into the discipline of solar flare forecasting. FLARECAST innovations were: first, the treatment of hundreds of physical properties viewed as promising flare predictors on equal footing, extending multiple previous works; second, the use of fourteen (14) different ML techniques, also on equal footing, to optimize the immense Big Data parameter space created by these many predictors; third, the establishment of a robust, three-pronged communication effort oriented toward policy makers, space-weather stakeholders and the wider public. FLARECAST pledged to make all its data, codes and infrastructure openly available worldwide. The combined use of 170+ properties (a total of 209 predictors are now available) in multiple ML algorithms, some of which were designed exclusively for the project, gave rise to changing sets of best-performing predictors for the forecasting of different flaring levels. At the same time, FLARECAST reaffirmed the importance of rigorous training and testing practices to avoid overly optimistic pre-operational prediction performance. In addition, the project has (a) tested new and revisited physically intuitive flare predictors and (b) provided meaningful clues toward the transition from flares to eruptive flares, namely, events associated with coronal mass ejections (CMEs). These leads, along with the FLARECAST data, algorithms and infrastructure, could help facilitate integrated space-weather forecasting efforts that take steps to avoid effort duplication. In spite of being one of the most intensive and systematic flare forecasting efforts to-date, FLARECAST has not managed to convincingly lift the barrier of stochasticity in solar flare occurrence and forecasting: solar flare prediction thus remains inherently probabilistic.
arXiv comment67 pages, 14 figures; submitted
References in corpus (29)
- An Observational Overview of Solar Flares
- The Helioseismic and Magnetic Imager (HMI) Vector Magnetic Field Pipeline: SHARPs -- Space-weather HMI Active Region Patches
- The Helioseismic and Magnetic Imager (HMI) Vector Magnetic Field Pipeline: Overview and Performance
- Class Imbalance Problem in Data Mining Review
- Understanding space weather to shield society: A global road map for 2015-2025 commissioned by COSPAR and ILWS
- The Challenge of Machine Learning in Space Weather Nowcasting and Forecasting
- Driving major solar flares and eruptions: a review
- A Comparison of Flare Forecasting Methods, I: Results from the "All-Clear" Workshop
- Solar Flare Prediction Model with Three Machine-Learning Algorithms Using Ultraviolet Brightening and Vector Magnetogram
- Deep Flare Net (DeFN) model for solar flare prediction
- Decoding the Pre-Eruptive Magnetic Field Configurations of Coronal Mass Ejections
- Simulations of Emerging Magnetic Flux. I: The Formation of Stable Coronal Flux Ropes
- A Comparison of Flare Forecasting Methods. II. Benchmarks, Metrics and Performance Results for Operational Solar Flare Forecasting Systems
- Successive X-class flares and coronal mass ejections driven by shearing motion and sunspot rotation in active region NOAA 12673
- Distribution of Electric Currents in Solar Active Regions
- On the nature of reconnection at a solar coronal null point above a separatrix dome
- A hybrid supervised/unsupervised machine learning approach to solar flare prediction
- Flare forecasting at the Met Office Space Weather Operations Centre
- Productivity of Solar Flares and Magnetic Helicity Injection in Active Regions
- Simulations of Emerging Magnetic Flux. II: The formation of Unstable Coronal Flux Ropes and the Initiation of CMEs
- Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events
- Feature ranking of active region source properties in solar flare forecasting and the uncompromised stochasticity of flare occurrence
- Non-neutralized electric currents in solar active regions and flare productivity
- UFCORIN: A Fully Automated Predictor of Solar Flares in GOES X-Ray Flux
- Flaring Rates and the Evolution of Sunspot Group McIntosh Classifications
- The Occurrence and Speed of CMEs Related to Two Characteristic Evolution Patterns of Helicity Injection in Their Solar Source Regions
- Verification of Space Weather Forecasts issued by the Met Office Space Weather Operations Centre
- Connecting Coronal Mass Ejections to their Solar Active Region Sources: Combining Results from the HELCATS and FLARECAST Projects
- Predictive Capabilities of Avalanche Models for Solar Flares