Verification of Space Weather Forecasts issued by the Met Office Space Weather Operations Centre

Abstract

The Met Office Space Weather Operations Centre was founded in 2014 and part of its remit is a daily Space Weather Technical Forecast to help the UK build resilience to space weather impacts; guidance includes four day geo-magnetic storm forecasts (GMSF) and X-ray flare forecasts (XRFF). It is crucial for forecasters, users, modelers and stakeholders to understand the strengths and weaknesses of these forecasts; therefore, it is important to verify against the most reliable truth data source available. The present study contains verification results for XRFFs using GOES-15 satellite data and GMSF using planetary K-index (Kp) values from the GFZ Helmholtz Centre. To assess the value of the verification results it is helpful to compare them against a reference forecast and the frequency of occurrence during a rolling prediction period is used for this purpose. Analysis of the rolling 12-month performance over a 19-month period suggests that both the XRFF and GMSF struggle to provide a better prediction than the reference. However, a relative operating characteristic and reliability analysis of the full 19-month period reveals that although the GMSF and XRFF possess discriminatory skill, events tend to be over-forecast.

arXiv commentPublished in Space Weather. 21 pages, 8 figures, 2 tables

References in corpus (2)

• A Statistical Solar Flare Forecast Method
• Flare forecasting at the Met Office Space Weather Operations Centre

Cited by in corpus (10)

• A Comparison of Flare Forecasting Methods. II. Benchmarks, Metrics and Performance Results for Operational Solar Flare Forecasting Systems
• The importance of ensemble techniques for operational space weather forecasting
• A Comparison of Flare Forecasting Methods. III. Systematic Behaviors of Operational Solar Flare Forecasting Systems
• A Comparison of Flare Forecasting Methods. IV. Evaluating Consecutive-Day Forecasting Patterns
• On the generation of probabilistic forecasts from deterministic models
• Collection, Collation, and Comparison of 3D Coronal CME Reconstructions
• Decreasing False Alarm Rates in ML-based Solar Flare Prediction using SDO/HMI Data
• Ensemble Forecasting of Major Solar Flares: Methods for Combining Models
• The Flare Likelihood and Region Eruption Forecasting (FLARECAST) Project: Flare forecasting in the big data & machine learning era
• Probabilistic Prediction of Geomagnetic Storms and the K${}_{\text{p}}$ Index