Forecasting the Arrival Time of Coronal Mass Ejections: Analysis of the CCMC CME Scoreboard
arXiv:1810.07289 · doi:10.1029/2018SW001962
Abstract
Accurate forecasting of the properties of coronal mass ejections as they approach Earth is now recognized as an important strategic objective for both NOAA and NASA. The time of arrival of such events is a key parameter, one that had been anticipated to be relatively straightforward to constrain. In this study, we analyze forecasts submitted to the Community Coordinated Modeling Center (CCMC) at NASA's Goddard Space Flight Center over the last six years to answer the following questions: (1) How well do these models forecast the arrival time of CME-driven shocks? (2) What are the uncertainties associated with these forecasts? (3) Which model(s) perform best? (4) Have the models become more accurate during the past six years? We analyze all forecasts made by 32 models from 2013 through mid 2018, and additionally focus on 28 events all of which were forecasted by six models. We find that the models are generally able to predict CME-shock arrival times -- in an average sense -- to within 10 hours, but with standard deviations often exceeding 20 hours. The best performers, on the other hand, maintained a mean error (bias) of -1 hour, a mean absolute error of 13 hours, and a precision (s.d.) of 15 hours. Finally, there is no evidence that the forecasts have become more accurate during this interval. We discuss the intrinsic simplifications of the various models analyzed, the limitations of this investigation, and suggest possible paths to improve these forecasts in the future.
References in corpus (8)
- Toward Reliable Benchmarking of Solar Flare Forecasting Methods
- Ensemble modeling of CMEs using the WSA-ENLIL+Cone model
- Modeling observations of solar coronal mass ejections with heliospheric imagers verified with the Heliophysics System Observatory
- Quantitative Comparison of Methods for Predicting the Arrival of Coronal Mass Ejections at Earth based on multi-view imaging
- Predicting the magnetic vectors within coronal mass ejections arriving at Earth: 1. Initial Architecture
- A STEREO Survey of Magnetic Cloud Coronal Mass Ejections Observed at Earth in 2008--2012
- Flare forecasting at the Met Office Space Weather Operations Centre
- Prediction of Geomagnetic Storm Strength from Inner Heliospheric In Situ Observations
Cited by in corpus (49)
- The Challenge of Machine Learning in Space Weather Nowcasting and Forecasting
- CME-CME Interactions as Sources of CME Geo-effectiveness: The Formation of the Complex Ejecta and Intense Geomagnetic Storm in Early September 2017
- Observation-based modelling of magnetised Coronal Mass Ejections with EUHFORIA
- Quantifying errors in 3D CME parameters derived from synthetic data using white-light reconstruction techniques
- Space Weather: From Solar Origins to Risks and Hazards Evolving in Time
- Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events
- Probabilistic Drag-Based Ensemble Model (DBEM) Evaluation for Heliospheric Propagation of CMEs
- Implementation and validation of the FRi3D flux rope model in EUHFORIA
- Turbulent cascade and energy transfer rate in a solar coronal mass ejection
- Deriving CME density from remote sensing data and comparison to in-situ measurements
- CMEs and SEPs During November-December 2020: A Challenge for Real-Time Space Weather Forecasting
- Evaluation of CME Arrival Prediction Using Ensemble Modeling Based on Heliospheric Imaging Observations
- CME Magnetic Structure and IMF Preconditioning Affecting SEP Transport
- Forecasting the Ambient Solar Wind with Numerical Models. II. An Adaptive Prediction System for Specifying Solar Wind Speed Near the Sun
- Modelling a multi-spacecraft coronal mass ejection encounter with EUHFORIA
- The effect of the ambient solar wind medium on a CME-driven shock and the associated gradual solar energetic particle event
- The effect of stream interaction regions on ICME structures observed in longitudinal conjunction
- Unusual plasma and particle signatures at Mars and STEREO-A related to CME-CME interaction
- Validation of Coronal Mass Ejection Arrival-Time Forecasts by Magnetohydrodynamic Simulations based on Interplanetary Scintillation Observations
- Using gradient boosting regression to improve ambient solar wind model predictions
- Multipoint study of successive coronal mass ejections driving moderate disturbances at 1 AU
- OSPREI: A Coupled Approach to Modeling CME-Driven Space Weather with Automatically-Generated, User-Friendly Outputs
- Modeling Interplanetary Expansion and Deformation of CMEs with ANTEATR-PARADE I: Relative Contribution of Different Forces
- Validation scheme for solar coronal models -- constraints from multi-perspective observations in EUV and white-light
- Ensemble simulations of the 12 July 2012 Coronal Mass Ejection with the Constant Turn Flux Rope Model
- Solar Ring Mission: Building a Panorama of the Sun and Inner-heliosphere
- Using Solar Orbiter as an upstream solar wind monitor for real time space weather predictions
- Propagating Conditions and the Time of ICMEs Arrival: A Comparison of the Effective Acceleration Model with ENLIL and DBEM Models
- Why are ELEvoHI CME arrival predictions different if based on STEREO-A or STEREO-B heliospheric imager observations?
- Drag-based CME modeling with heliospheric images incorporating frontal deformation: ELEvoHI 2.0
- Modeling a Coronal Mass Ejection from an Extended Filament Channel. II. Interplanetary Propagation to 1 au
- Improving the Arrival Time Estimates of Coronal Mass Ejections by Using Magnetohydrodynamic Ensemble Modeling, Heliospheric Imager data, and Machine Learning
- An Insight into the Coupling of CME Kinematics in Inner and Outer Corona and the Imprint of Source Regions
- Quantifying the uncertainty in CME kinematics derived from geometric modelling of Heliospheric Imager data
- Automated Detection of Accelerating Solar Eruptions using Parabolic Hough Transform
- Improved modelling of SEP event onset within the WSA-Enlil-SEPMOD framework
- A coronal mass ejection encountered by four spacecraft within 1 au from the Sun: Ensemble modelling of propagation and magnetic structure
- Magnetohydrodynamic simulation of coronal mass ejections using interplanetary scintillation data observed from radio sites ISEE and LOFAR
- Predicting CMEs using ELEvoHI with STEREO-HI beacon data
- Automated detection of coronaL MAss ejecta origiNs for space weather AppliCations (ALMANAC)
- Validation of EUHFORIA cone and spheromak Coronal Mass Ejection Models
- Tracing the ICME plasma with a MHD simulation
- Space weather: the solar perspective -- an update to Schwenn (2006)
- Hit or Miss, Arrival Time, and Orientation Predictions of BATS-R-US CME Simulations at 1 AU
- Magnetic connectivity from the Sun to the Earth with MHD models I. Impact of the magnetic modelling for connectivity validation
- A catalogue of observed geo-effective CME/ICME characteristics
- Earth-affecting Solar Transients: A Review of Progresses in Solar Cycle 24
- Predicting the Magnetic Fields of a Stealth CME Detected by Parker Solar Probe at 0.5 AU
- Investigating potential benefits of future sub-L1 missions with STEREO-A