activity
20212026
most citedscores: A Python package for verifying and evaluating models and predictions with xarray

13 citations · 23 across the 9 of their papers we have counts for

collaborators

10 papers

math.ST2026

On equitable scoring functions and optimal forecasting behaviour

Robert J. Taggart, Nicholas Loveday

Equitable scoring functions have a long history in meteorological forecast verification and have recently gained renewed prominence through the use of the Stable Equitable Error in…

cs.LG2026

Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather

Amy McGovern, Taylor Mandelbaum, Daniel Rothenberg +6

Forecasting the wide variety of high-impact weather events experienced globally is a challenge for both Artificial Intelligence (AI) and Numerical Weather Prediction (NWP) models a…

physics.ao-ph2026

WP-MIP: An Artificial Intelligence, Hybrid, and Physically Based Model Intercomparison Project for Weather Prediction

Ron McTaggart-Cowan, Linus Magnusson, Inna Polichtchouk +57

Rapid progress in the field of machine-learning for weather prediction has led to the emergence of algorithms whose forecasting skill can exceed that of traditional physically base…

math.ST2026

Evaluating time-to-event forecasts under fixed-horizon right-censoring

Robert J. Taggart, Nicholas Loveday, Simon Louis

Time-to-event forecasts frequently arise in applications with finite prediction or decision horizons, including in operational meteorology, hydrology, warranty analysis and insuran…

physics.ao-ph2025★ 1 cited

Evaluating Extreme Precipitation Forecasts: A Threshold-Weighted, Spatial Verification Approach for Comparing an AI Weather Prediction Model Against a High-Resolution NWP Model

Nicholas Loveday, Tracy Hertneky

Recent advances in AI-based weather prediction have led to the development of artificial intelligence weather prediction (AIWP) models with competitive forecast skill compared to t…

physics.ao-ph2024★ 13 cited

scores: A Python package for verifying and evaluating models and predictions with xarray

Tennessee Leeuwenburg, Nicholas Loveday, Elizabeth E. Ebert +8

`scores` is a Python package containing mathematical functions for the verification, evaluation and optimisation of forecasts, predictions or models. It supports labelled n-dimensi…

physics.ao-ph2024★ 1 cited

Evaluation and statistical correction of area-based heat index forecasts that drive a heatwave warning service

Nicholas Loveday, Maree Carroll

This study evaluates the performance of the area-based, district heatwave forecasts that drive the Australian heatwave warning service. The analysis involves using a recently devel…

physics.ao-ph2024★ 3 cited

The Jive Verification System and its Transformative Impact on Weather Forecasting Operations

Nicholas Loveday, Deryn Griffiths, Tennessee Leeuwenburg +9

Forecast verification is critical for continuous improvement in meteorological organizations. The Jive verification system was originally developed to assess the accuracy of public…

stat.AP2023★ 1 cited

A User-Focused Approach to Evaluating Probabilistic and Categorical Forecasts

Nicholas Loveday, Robert Taggart, Mohammadreza Khanarmuei

A user-focused verification approach for evaluating probability forecasts of binary outcomes (also known as probabilistic classifiers) is demonstrated that is (i) based on proper s…

stat.AP2021★ 4 cited

A scoring framework for tiered warnings and multicategorical forecasts based on fixed risk measures

Robert Taggart, Nicholas Loveday, Deryn Griffiths

The use of tiered warnings and multicategorical forecasts are ubiquitous in meteorological operations. Here, a flexible family of scoring functions is presented for evaluating the…