Detecting Out-of-distribution Samples via Variational Auto-encoder with Reliable Uncertainty Estimation
arXiv:2007.08128
Abstract
Variational autoencoders (VAEs) are influential generative models with rich representation capabilities from the deep neural network architecture and Bayesian method. However, VAE models have a weakness that assign a higher likelihood to out-of-distribution (OOD) inputs than in-distribution (ID) inputs. To address this problem, a reliable uncertainty estimation is considered to be critical for in-depth understanding of OOD inputs. In this study, we propose an improved noise contrastive prior (INCP) to be able to integrate into the encoder of VAEs, called INCPVAE. INCP is scalable, trainable and compatible with VAEs, and it also adopts the merits from the INCP for uncertainty estimation. Experiments on various datasets demonstrate that compared to the standard VAEs, our model is superior in uncertainty estimation for the OOD data and is robust in anomaly detection tasks. The INCPVAE model obtains reliable uncertainty estimation for OOD inputs and solves the OOD problem in VAE models.
References in corpus (12)
- On Calibration of Modern Neural Networks
- Deep Anomaly Detection with Outlier Exposure
- WAIC, but Why? Generative Ensembles for Robust Anomaly Detection
- Input complexity and out-of-distribution detection with likelihood-based generative models
- Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encoder
- Improving Reconstruction Autoencoder Out-of-distribution Detection with Mahalanobis Distance
- Uncertainty in the Variational Information Bottleneck
- Unsupervised Anomaly Detection in Stream Data with Online Evolving Spiking Neural Networks
- Do Deep Generative Models Know What They Don't Know?
- Detecting Out-of-Distribution Inputs to Deep Generative Models Using Typicality
- Bayesian Variational Autoencoders for Unsupervised Out-of-Distribution Detection
- Variational f-divergence Minimization