Diffusion Normalizing Flow
arXiv:2110.07579
Abstract
We present a novel generative modeling method called diffusion normalizing flow based on stochastic differential equations (SDEs). The algorithm consists of two neural SDEs: a forward SDE that gradually adds noise to the data to transform the data into Gaussian random noise, and a backward SDE that gradually removes the noise to sample from the data distribution. By jointly training the two neural SDEs to minimize a common cost function that quantifies the difference between the two, the backward SDE converges to a diffusion process the starts with a Gaussian distribution and ends with the desired data distribution. Our method is closely related to normalizing flow and diffusion probabilistic models and can be viewed as a combination of the two. Compared with normalizing flow, diffusion normalizing flow is able to learn distributions with sharp boundaries. Compared with diffusion probabilistic models, diffusion normalizing flow requires fewer discretization steps and thus has better sampling efficiency. Our algorithm demonstrates competitive performance in both high-dimension data density estimation and image generation tasks.
arXiv commentNeurips 2021
References in corpus (14)
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Auto-Encoding Variational Bayes
- Denoising Diffusion Probabilistic Models
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Variational Inference with Normalizing Flows
- Density estimation using Real NVP
- Improved Denoising Diffusion Probabilistic Models
- MADE: Masked Autoencoder for Distribution Estimation
- Flow++: Improving Flow-Based Generative Models with Variational Dequantization and Architecture Design
- Residual Flows for Invertible Generative Modeling
- Improved Techniques for Training Score-Based Generative Models
- DiffWave: A Versatile Diffusion Model for Audio Synthesis
- Adversarial score matching and improved sampling for image generation
- A RAD approach to deep mixture models