832 citations · 1.3k across the 79 of their papers we have counts for
4 papers · 1 filter
The Variational Deficiency Bottleneck
Pradeep Kr. Banerjee, Guido Montúfar
We introduce a bottleneck method for learning data representations based on information deficiency, rather than the more traditional information sufficiency. A variational upper bo…
Ricci curvature for parametric statistics via optimal transport
Wuchen Li, Guido Montufar
We elaborate the notion of a Ricci curvature lower bound for parametrized statistical models. Following the seminal ideas of Lott-Strum-Villani, we define this notion based on the…
Restricted Boltzmann Machines: Introduction and Review
Guido Montufar
The restricted Boltzmann machine is a network of stochastic units with undirected interactions between pairs of visible and hidden units. This model was popularized as a building b…
Natural gradient via optimal transport
Wuchen Li, Guido Montufar
We study a natural Wasserstein gradient flow on manifolds of probability distributions with discrete sample spaces. We derive the Riemannian structure for the probability simplex f…