Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events

Abstract

Accurate forecasting of the arrival time and subsequent geomagnetic impacts of Coronal Mass Ejections (CMEs) at Earth is an important objective for space weather forecasting agencies. Recently, the CME Arrival and Impact working team has made significant progress towards defining community-agreed metrics and validation methods to assess the current state of CME modeling capabilities. This will allow the community to quantify our current capabilities and track progress in models over time. Firstly, it is crucial that the community focuses on the collection of the necessary metadata for transparency and reproducibility of results. Concerning CME arrival and impact we have identified 6 different metadata types: 3D CME measurement, model description, model input, CME (non-)arrival observation, model output data and metrics and validation methods. Secondly, the working team has also identified a validation time period, where all events within the following two periods will be considered: 1 January 2011-31 December 2012 and January 2015-31 December 2015. Those two periods amount to a total of about 100 hit events at Earth and a large amount of misses. Considering a time period will remove any bias in selecting events and the event set will represent a sample set that will not be biased by user selection. Lastly, we have defined the basic metrics and skill scores that the CME Arrival and Impact working team will focus on.

arXiv commentspecial issue: Space Weather Capabilities Assessment

References in corpus (16)

• Alfven Wave Solar Model (AWSoM): Coronal Heating
• Understanding space weather to shield society: A global road map for 2015-2025 commissioned by COSPAR and ILWS
• Automated LASCO CME catalog for solar cycle 23: are CMEs scale invariant?
• Strong coronal channelling and interplanetary evolution of a solar storm up to Earth and Mars
• Ensemble modeling of CMEs using the WSA-ENLIL+Cone model
• MHD Waves and Coronal Heating: Unifying Empirical and MHD Turbulence Models
• Forecasting the Arrival Time of Coronal Mass Ejections: Analysis of the CCMC CME Scoreboard
• Connecting speeds, directions and arrival times of 22 coronal mass ejections from the Sun to 1 AU
• Data Constrained Coronal Mass Ejections in A Global Magnetohydrodynamics Model
• Drag-Based Ensemble Model (DBEM) for Coronal Mass Ejection Propagation
• Automatic Detection and Tracking of CMEs II: Multiscale Filtering of Coronagraph Data
• Full Halo Coronal Mass Ejections: Arrival at the Earth
• Could the collision of CMEs in the heliosphere be super-elastic? --- Validation through three-dimensional simulations
• Propagation of the 7 January 2014 CME and Resulting Geomagnetic Non-Event
• Ensemble Prediction of a Halo Coronal Mass Ejection Using Heliospheric Imagers
• On the Propagation of a Geoeffective Coronal Mass Ejection during March 15 -- 17, 2015

Cited by in corpus (23)

• CME-CME Interactions as Sources of CME Geo-effectiveness: The Formation of the Complex Ejecta and Intense Geomagnetic Storm in Early September 2017
• Observation-based modelling of magnetised Coronal Mass Ejections with EUHFORIA
• Quantifying errors in 3D CME parameters derived from synthetic data using white-light reconstruction techniques
• Probabilistic Drag-Based Ensemble Model (DBEM) Evaluation for Heliospheric Propagation of CMEs
• CMEs and SEPs During November-December 2020: A Challenge for Real-Time Space Weather Forecasting
• CME Magnetic Structure and IMF Preconditioning Affecting SEP Transport
• Forecasting the Ambient Solar Wind with Numerical Models. II. An Adaptive Prediction System for Specifying Solar Wind Speed Near the Sun
• Modelling a multi-spacecraft coronal mass ejection encounter with EUHFORIA
• Using gradient boosting regression to improve ambient solar wind model predictions
• Wave pressure and energy cascade rate of kink waves computed with Elsasser variables
• Assessing the projection correction of Coronal Mass Ejection speeds on Time-of-Arrival prediction performance using the Effective Acceleration Model
• Validation scheme for solar coronal models -- constraints from multi-perspective observations in EUV and white-light
• Using Solar Orbiter as an upstream solar wind monitor for real time space weather predictions
• Propagating Conditions and the Time of ICMEs Arrival: A Comparison of the Effective Acceleration Model with ENLIL and DBEM Models
• Parameter Distributions for the Drag-Based Modeling of CME Propagation
• Quantifying the uncertainty in CME kinematics derived from geometric modelling of Heliospheric Imager data
• A coronal mass ejection encountered by four spacecraft within 1 au from the Sun: Ensemble modelling of propagation and magnetic structure
• Global Energetics of Solar Flares: VII. Aerodynamic Drag in Coronal Mass Ejections
• Validation of EUHFORIA cone and spheromak Coronal Mass Ejection Models
• Space weather: the solar perspective -- an update to Schwenn (2006)
• Hit or Miss, Arrival Time, and $B_z$ Orientation Predictions of BATS-R-US CME Simulations at 1 AU
• The Flare Likelihood and Region Eruption Forecasting (FLARECAST) Project: Flare forecasting in the big data & machine learning era
• Earth-affecting Solar Transients: A Review of Progresses in Solar Cycle 24