Robust Deep Gaussian Processes
arXiv:1904.02303
Abstract
This report provides an in-depth overview over the implications and novelty Generalized Variational Inference (GVI) (Knoblauch et al., 2019) brings to Deep Gaussian Processes (DGPs) (Damianou & Lawrence, 2013). Specifically, robustness to model misspecification as well as principled alternatives for uncertainty quantification are motivated with an information-geometric view. These modifications have clear interpretations and can be implemented in less than 100 lines of Python code. Most importantly, the corresponding empirical results show that DGPs can greatly benefit from the presented enhancements.
11 pages, 4 figures
References in corpus (11)
- Adam: A Method for Stochastic Optimization
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- Probabilistic Backpropagation for Scalable Learning of Bayesian Neural Networks
- Variational Dropout and the Local Reparameterization Trick
- Gaussian Processes for Big Data
- Deep Gaussian Processes for Regression using Approximate Expectation Propagation
- Random Feature Expansions for Deep Gaussian Processes
- Principles of Bayesian Inference using General Divergence Criteria
- Variational Auto-encoded Deep Gaussian Processes
- Generalized Variational Inference: Three arguments for deriving new Posteriors
- Nested Variational Compression in Deep Gaussian Processes
Cited by in corpus (6)
- Generalized Variational Inference: Three arguments for deriving new Posteriors
- Learning under Model Misspecification: Applications to Variational and Ensemble methods
- Transforming Gaussian Processes With Normalizing Flows
- Parametric Gaussian Process Regressors
- Deep Sigma Point Processes
- Direct loss minimization algorithms for sparse Gaussian processes