2.5k citations · 9k across the 32 of their papers we have counts for
4 papers · 1 filter
Learning Implicit Generative Models with the Method of Learned Moments
Suman Ravuri, Shakir Mohamed, Mihaela Rosca +1
We propose a method of moments (MoM) algorithm for training large-scale implicit generative models. Moment estimation in this setting encounters two problems: it is often difficult…
Implicit Reparameterization Gradients
Michael Figurnov, Shakir Mohamed, Andriy Mnih
By providing a simple and efficient way of computing low-variance gradients of continuous random variables, the reparameterization trick has become the technique of choice for trai…
Unsupervised Predictive Memory in a Goal-Directed Agent
Greg Wayne, Chia-Chun Hung, David Amos +21
Animals execute goal-directed behaviours despite the limited range and scope of their sensors. To cope, they explore environments and store memories maintaining estimates of import…
Distribution Matching in Variational Inference
Mihaela Rosca, Balaji Lakshminarayanan, Shakir Mohamed
With the increasingly widespread deployment of generative models, there is a mounting need for a deeper understanding of their behaviors and limitations. In this paper, we expose t…