Kaggle forecasting competitions: An overlooked learning opportunity

Abstract

Competitions play an invaluable role in the field of forecasting, as exemplified through the recent M4 competition. The competition received attention from both academics and practitioners and sparked discussions around the representativeness of the data for business forecasting. Several competitions featuring real-life business forecasting tasks on the Kaggle platform has, however, been largely ignored by the academic community. We believe the learnings from these competitions have much to offer to the forecasting community and provide a review of the results from six Kaggle competitions. We find that most of the Kaggle datasets are characterized by higher intermittence and entropy than the M-competitions and that global ensemble models tend to outperform local single models. Furthermore, we find the strong performance of gradient boosted decision trees, increasing success of neural networks for forecasting, and a variety of techniques for adapting machine learning models to the forecasting task.

References in corpus (3)

• XGBoost: A Scalable Tree Boosting System
• Entity Embeddings of Categorical Variables
• NGBoost: Natural Gradient Boosting for Probabilistic Prediction

Cited by in corpus (16)

• Deep Neural Networks and Tabular Data: A Survey
• Ensembles of Localised Models for Time Series Forecasting
• Fit4CAD: A point cloud benchmark for fitting simple geometric primitives in CAD objects
• Forecasting: theory and practice
• CyPhERS: A Cyber-Physical Event Reasoning System providing real-time situational awareness for attack and fault response
• How to effectively use machine learning models to predict the solutions for optimization problems: lessons from loss function
• A review of machine learning concepts and methods for addressing challenges in probabilistic hydrological post-processing and forecasting
• Monash Time Series Forecasting Archive
• Coresets for Decision Trees of Signals
• Using spatial extreme-value theory with machine learning to model and understand spatially compounding weather extremes
• Learning to detect continuous gravitational waves: an open data-analysis competition
• A hybrid ensemble method with negative correlation learning for regression
• Observing Fine-Grained Changes in Jupyter Notebooks During Development Time
• Improving the accuracy of freight mode choice models: A case study using the 2017 CFS PUF data set and ensemble learning techniques
• Synergetic Learning of Heterogeneous Temporal Sequences for Multi-Horizon Probabilistic Forecasting
• A step towards the integration of machine learning and classic model-based survey methods