How to Evaluate Uncertainty Estimates in Machine Learning for Regression?

Abstract

As neural networks become more popular, the need for accompanying uncertainty estimates increases. There are currently two main approaches to test the quality of these estimates. Most methods output a density. They can be compared by evaluating their loglikelihood on a test set. Other methods output a prediction interval directly. These methods are often tested by examining the fraction of test points that fall inside the corresponding prediction intervals. Intuitively both approaches seem logical. However, we demonstrate through both theoretical arguments and simulations that both ways of evaluating the quality of uncertainty estimates have serious flaws. Firstly, both approaches cannot disentangle the separate components that jointly create the predictive uncertainty, making it difficult to evaluate the quality of the estimates of these components. Secondly, a better loglikelihood does not guarantee better prediction intervals, which is what the methods are often used for in practice. Moreover, the current approach to test prediction intervals directly has additional flaws. We show why it is fundamentally flawed to test a prediction or confidence interval on a single test set. At best, marginal coverage is measured, implicitly averaging out overconfident and underconfident predictions. A much more desirable property is pointwise coverage, requiring the correct coverage for each prediction. We demonstrate through practical examples that these effects can result in favoring a method, based on the predictive uncertainty, that has undesirable behaviour of the confidence or prediction intervals. Finally, we propose a simulation-based testing approach that addresses these problems while still allowing easy comparison between different methods.

14 pages, 10 figures

References in corpus (5)

• Probabilistic Backpropagation for Scalable Learning of Bayesian Neural Networks
• Valid prediction intervals for regression problems
• A Survey on Uncertainty Quantification Methods for Deep Learning
• Uncertainty Aware Neural Network from Similarity and Sensitivity
• Peaking into the Black-box: Prediction Intervals Give Insight into Data-driven Quadrotor Model Reliability

Cited by in corpus (7)

• Uncertainty Quantification of Wind Gust Predictions in the Northeast United States: An Evidential Neural Network and Explainable Artificial Intelligence Approach
• Active and transfer learning with partially Bayesian neural networks for materials and chemicals
• Uncertainty-Aware Online Extrinsic Calibration: A Conformal Prediction Approach
• Single- to multi-fidelity history-dependent learning with uncertainty quantification and disentanglement: application to data-driven constitutive modeling
• Evaluating the Quality of the Quantified Uncertainty for (Re)Calibration of Data-Driven Regression Models
• Statistical Study of Balmer Continuum Enhancement in Solar Flares
• Multivariate Uncertainty Quantification with Tomographic Quantile Forests