Tighter Bounds on the Information Bottleneck with Application to Deep Learning

Nir Weingarten, Zohar Yakhini, Moshe Butman +1

Deep Neural Nets (DNNs) learn latent representations induced by their downstream task, objective function, and other parameters. The quality of the learned representations impacts…