Deep Huber quantile regression networks
arXiv:2306.10306 · doi:10.1016/j.neunet.2025.107364
Abstract
Typical machine learning regression applications aim to report the mean or the median of the predictive probability distribution, via training with a squared or an absolute error scoring function. The importance of issuing predictions of more functionals of the predictive probability distribution (quantiles and expectiles) has been recognized as a means to quantify the uncertainty of the prediction. In deep learning (DL) applications, that is possible through quantile and expectile regression neural networks (QRNN and ERNN respectively). Here we introduce deep Huber quantile regression networks (DHQRN) that nest QRNN and ERNN as edge cases. DHQRN can predict Huber quantiles, which are more general functionals in the sense that they nest quantiles and expectiles as limiting cases. The main idea is to train a DL algorithm with the Huber quantile scoring function, which is consistent for the Huber quantile functional. As a proof of concept, DHQRN are applied to predict house prices in Melbourne, Australia and Boston, United States (US). In this context, predictive performances of three DL architectures are discussed along with evidential interpretation of results from two economic case studies. Additional simulation experiments and applications to real-world case studies using open datasets demonstrate a satisfactory absolute performance of DHQRN.
40 pages, 11 figures, 4 tables
References in corpus (12)
- Scikit-learn: Machine Learning in Python
- Array Programming with NumPy
- Deep Learning in Neural Networks: An Overview
- A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
- Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methods
- A review of predictive uncertainty estimation with machine learning
- A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applications
- Quantification of predictive uncertainty in hydrological modelling by harnessing the wisdom of the crowd: A large-sample experiment at monthly timescale
- Point forecasting and forecast evaluation with generalized Huber loss
- Hydrological post-processing for predicting extreme quantiles
- Characterizing M-estimators
- Uncertainty estimation of machine learning spatial precipitation predictions from satellite data