The Variational Deficiency Bottleneck

Pradeep Kr. Banerjee, Guido Montúfar

We introduce a bottleneck method for learning data representations based on information deficiency, rather than the more traditional information sufficiency. A variational upper bo…