M5 Competition Uncertainty: Overdispersion, distributional forecasting, GAMLSS and beyond

Abstract

The M5 competition uncertainty track aims for probabilistic forecasting of sales of thousands of Walmart retail goods. We show that the M5 competition data faces strong overdispersion and sporadic demand, especially zero demand. We discuss resulting modeling issues concerning adequate probabilistic forecasting of such count data processes. Unfortunately, the majority of popular prediction methods used in the M5 competition (e.g. lightgbm and xgboost GBMs) fails to address the data characteristics due to the considered objective functions. The distributional forecasting provides a suitable modeling approach for to the overcome those problems. The GAMLSS framework allows flexible probabilistic forecasting using low dimensional distributions. We illustrate, how the GAMLSS approach can be applied for the M5 competition data by modeling the location and scale parameter of various distributions, e.g. the negative binomial distribution. Finally, we discuss software packages for distributional modeling and their drawback, like the R package gamlss with its package extensions, and (deep) distributional forecasting libraries such as TensorFlow Probability.

References in corpus (9)

• Quantile and Probability Curves Without Crossing
• TensorFlow Distributions
• Bayesian structured additive distributional regression with an application to regional income inequality in Germany
• A hybrid model of kernel density estimation and quantile regression for GEFCom2014 probabilistic load forecasting
• Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories
• Deep Distributional Time Series Models and the Probabilistic Forecasting of Intraday Electricity Prices
• Forecasting: theory and practice
• XGBoostLSS -- An extension of XGBoost to probabilistic forecasting
• deepregression: a Flexible Neural Network Framework for Semi-Structured Deep Distributional Regression

Cited by in corpus (5)

• A review of predictive uncertainty estimation with machine learning
• High-Resolution Peak Demand Estimation Using Generalized Additive Models and Deep Neural Networks
• Simulation-based Forecasting for Intraday Power Markets: Modelling Fundamental Drivers for Location, Shape and Scale of the Price Distribution
• Multivariate Simulation-based Forecasting for Intraday Power Markets: Modelling Cross-Product Price Effects
• A white-boxed ISSM approach to estimate uncertainty distributions of Walmart sales