Deep Gaussian Processes: A Survey

Abstract

Gaussian processes are one of the dominant approaches in Bayesian learning. Although the approach has been applied to numerous problems with great success, it has a few fundamental limitations. Multiple methods in literature have addressed these limitations. However, there has not been a comprehensive survey of the topics as of yet. Most existing surveys focus on only one particular variant of Gaussian processes and their derivatives. This survey details the core motivations for using Gaussian processes, their mathematical formulations, limitations, and research themes that have flourished over the years to address said limitations. Furthermore, one particular research area is Deep Gaussian Processes (DGPs), it has improved substantially in the past decade. The significant publications that advanced the forefront of this research area are outlined in their survey. Finally, a brief discussion on open problems and research directions for future work is presented at the end.

arXiv comment23 pages, 5 figures

References in corpus (8)

• Weight Uncertainty in Neural Networks
• Stochastic Gradient Hamiltonian Monte Carlo
• Gaussian Processes for Big Data
• Stochastic Variational Deep Kernel Learning
• Variational Auto-encoded Deep Gaussian Processes
• Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo
• Variational Gaussian Process Dynamical Systems
• Energy-Based Processes for Exchangeable Data

Cited by in corpus (3)

• Deep Gaussian Processes for Air Quality Inference
• Relaxed Gaussian process interpolation: a goal-oriented approach to Bayesian optimization
• Multi-Task Neural Processes