A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applications

Abstract

Quantifying the uncertainty of supervised learning models plays an important role in making more reliable predictions. Epistemic uncertainty, which usually is due to insufficient knowledge about the model, can be reduced by collecting more data or refining the learning models. Over the last few years, scholars have proposed many epistemic uncertainty handling techniques which can be roughly grouped into two categories, i.e., Bayesian and ensemble. This paper provides a comprehensive review of epistemic uncertainty learning techniques in supervised learning over the last five years. As such, we, first, decompose the epistemic uncertainty into bias and variance terms. Then, a hierarchical categorization of epistemic uncertainty learning techniques along with their representative models is introduced. In addition, several applications such as computer vision (CV) and natural language processing (NLP) are presented, followed by a discussion on research gaps and possible future research directions.

45pages, 4 figures

References in corpus (8)

• Weight Uncertainty in Neural Networks
• Deep and Confident Prediction for Time Series at Uber
• Perfect Sampling Using Bounding Chains
• MCUa: Multi-level Context and Uncertainty aware Dynamic Deep Ensemble for Breast Cancer Histology Image Classification
• Bayesian graph convolutional neural networks via tempered MCMC
• Single Shot MC Dropout Approximation
• Estimating Model Uncertainty of Neural Networks in Sparse Information Form
• L2M: Practical posterior Laplace approximation with optimization-driven second moment estimation

Cited by in corpus (8)

• A review of predictive uncertainty estimation with machine learning
• DC-cycleGAN: Bidirectional CT-to-MR Synthesis from Unpaired Data
• How False Data Affects Machine Learning Models in Electrochemistry?
• Uncertainty Aware Neural Network from Similarity and Sensitivity
• Deep Huber quantile regression networks
• Learning From High-Dimensional Cyber-Physical Data Streams for Diagnosing Faults in Smart Grids
• ProBoost: a Boosting Method for Probabilistic Classifiers
• Uncertainty in AI-driven Monte Carlo simulations