Gaussian Process Conditional Density Estimation
arXiv:1810.12750
Abstract
Conditional Density Estimation (CDE) models deal with estimating conditional distributions. The conditions imposed on the distribution are the inputs of the model. CDE is a challenging task as there is a fundamental trade-off between model complexity, representational capacity and overfitting. In this work, we propose to extend the model's input with latent variables and use Gaussian processes (GP) to map this augmented input onto samples from the conditional distribution. Our Bayesian approach allows for the modeling of small datasets, but we also provide the machinery for it to be applied to big data using stochastic variational inference. Our approach can be used to model densities even in sparse data regions, and allows for sharing learned structure between conditions. We illustrate the effectiveness and wide-reaching applicability of our model on a variety of real-world problems, such as spatio-temporal density estimation of taxi drop-offs, non-Gaussian noise modeling, and few-shot learning on omniglot images.
References in corpus (4)
Cited by in corpus (12)
- CD-split and HPD-split: efficient conformal regions in high dimensions
- A Tutorial on Sparse Gaussian Processes and Variational Inference
- Noise Contrastive Meta-Learning for Conditional Density Estimation using Kernel Mean Embeddings
- Diagnostics for Conditional Density Models and Bayesian Inference Algorithms
- Large-scale Heteroscedastic Regression via Gaussian Process
- Wide Neural Networks with Bottlenecks are Deep Gaussian Processes
- Kernel Instrumental Variable Regression
- Sparse Spectrum Warped Input Measures for Nonstationary Kernel Learning
- Testing Goodness of Fit of Conditional Density Models with Kernels
- Quantifying Epistemic Uncertainty in Deep Learning
- Wasserstein Random Forests and Applications in Heterogeneous Treatment Effects
- Conditional Density Estimation via Weighted Logistic Regressions