PIVEN: A Deep Neural Network for Prediction Intervals with Specific Value Prediction
arXiv:2006.05139
Abstract
Improving the robustness of neural nets in regression tasks is key to their application in multiple domains. Deep learning-based approaches aim to achieve this goal either by improving their prediction of specific values (i.e., point prediction), or by producing prediction intervals (PIs) that quantify uncertainty. We present PIVEN, a deep neural network for producing both a PI and a value prediction. Our loss function expresses the value prediction as a function of the upper and lower bounds, thus ensuring that it falls within the interval without increasing model complexity. Moreover, our approach makes no assumptions regarding data distribution within the PI, making its value prediction more effective for various real-world problems. Experiments and ablation tests on known benchmarks show that our approach produces tighter uncertainty bounds than the current state-of-the-art approaches for producing PIs, while maintaining comparable performance to the state-of-the-art approach for value-prediction. Additionally, we go beyond previous work and include large image datasets in our evaluation, where PIVEN is combined with modern neural nets.
arXiv comment19 pages
References in corpus (13)
- Adam: A Method for Stochastic Optimization
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- End to End Learning for Self-Driving Cars
- What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
- Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift
- Probabilistic Backpropagation for Scalable Learning of Bayesian Neural Networks
- High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approach
- The Two-Piece Normal, Binormal, or Double Gaussian Distribution: Its Origin and Rediscoveries
- Single-Model Uncertainties for Deep Learning
- Adaptive, Distribution-Free Prediction Intervals for Deep Networks
- Deep Drone Racing: Learning Agile Flight in Dynamic Environments
- Quantifying Facial Age by Posterior of Age Comparisons
- Quantifying Point-Prediction Uncertainty in Neural Networks via Residual Estimation with an I/O Kernel