Publications (49)
On Variational Bounds of Mutual Information
Ben Poole, Sherjil Ozair, Aaron van den Oord +2
Estimating and optimizing Mutual Information (MI) is core to many problems in machine learning; however, bounding MI in high dimensions is challenging. To establish tractable and s…
Weakly Supervised Disentanglement with Guarantees
Rui Shu, Yining Chen, Abhishek Kumar +2
Learning disentangled representations that correspond to factors of variation in real-world data is critical to interpretable and human-controllable machine learning. Recently, con…
Fast large-scale optimization by unifying stochastic gradient and quasi-Newton methods
Jascha Sohl-Dickstein, Ben Poole, Surya Ganguli
We present an algorithm for minimizing a sum of functions that combines the computational efficiency of stochastic gradient descent (SGD) with the second order curvature informatio…
Imagen Video: High Definition Video Generation with Diffusion Models
Jonathan Ho, William Chan, Chitwan Saharia +8
We present Imagen Video, a text-conditional video generation system based on a cascade of video diffusion models. Given a text prompt, Imagen Video generates high definition videos…
Improved generator objectives for GANs
Ben Poole, Alexander A. Alemi, Jascha Sohl-Dickstein +1
We present a framework to understand GAN training as alternating density ratio estimation and approximate divergence minimization. This provides an interpretation for the mismatche…
Masks make discriminative models great again!
Tianshi Cao, Marie-Julie Rakotosaona, Ben Poole +2
We present Image2GS, a novel approach that addresses the challenging problem of reconstructing photorealistic 3D scenes from a single image by focusing specifically on the image-to…