354 citations · 1.9k across the 38 of their papers we have counts for
4 papers · 1 filter
-VAEs can retain label information even at high compression
Emily Fertig, Aryan Arbabi, Alexander A. Alemi
In this paper, we investigate the degree to which the encoding of a -VAE captures label information across multiple architectures on Binary Static MNIST and Omniglot. Even thoug…
Uncertainty in the Variational Information Bottleneck
Alexander A. Alemi, Ian Fischer, Joshua V. Dillon
We present a simple case study, demonstrating that Variational Information Bottleneck (VIB) can improve a network's classification calibration as well as its ability to detect out-…
TherML: Thermodynamics of Machine Learning
Alexander A. Alemi, Ian Fischer
In this work we offer a framework for reasoning about a wide class of existing objectives in machine learning. We develop a formal correspondence between this work and thermodynami…
GILBO: One Metric to Measure Them All
Alexander A. Alemi, Ian Fischer
We propose a simple, tractable lower bound on the mutual information contained in the joint generative density of any latent variable generative model: the GILBO (Generative Inform…