A Deep Generative Approach to Conditional Sampling
arXiv:2110.10277
Abstract
We propose a deep generative approach to sampling from a conditional distribution based on a unified formulation of conditional distribution and generalized nonparametric regression function using the noise-outsourcing lemma. The proposed approach aims at learning a conditional generator so that a random sample from the target conditional distribution can be obtained by the action of the conditional generator on a sample drawn from a reference distribution. The conditional generator is estimated nonparametrically with neural networks by matching appropriate joint distributions using the Kullback-Liebler divergence. An appealing aspect of our method is that it allows either of or both the predictor and the response to be high-dimensional and can handle both continuous and discrete type predictors and responses. We show that the proposed method is consistent in the sense that the conditional generator converges in distribution to the underlying conditional distribution under mild conditions. Our numerical experiments with simulated and benchmark image data validate the proposed method and demonstrate that it outperforms several existing conditional density estimation methods.
arXiv comment62 pages, 10 figures. Xingyu Zhou and Yuling Jiao contributed equally to this work. Corresponding author: Jian Huang ([email protected])
References in corpus (10)
- Deep Learning in Neural Networks: An Overview
- Conditional Generative Adversarial Nets
- Estimating divergence functionals and the likelihood ratio by convex risk minimization
- Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks
- Nonparametric Conditional Density Estimation in a High-Dimensional Regression Setting
- Conditional Density Estimation Tools in Python and R with Applications to Photometric Redshifts and Likelihood-Free Cosmological Inference
- On the rate of convergence of fully connected very deep neural network regression estimates
- Deep Nonparametric Regression on Approximate Manifolds: Non-Asymptotic Error Bounds with Polynomial Prefactors
- Deep Quantile Regression: Mitigating the Curse of Dimensionality Through Composition
- Robust Nonparametric Regression with Deep Neural Networks