Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneck

K. Michael Martini, Ilya Nemenman

The Symmetric Information Bottleneck (SIB), an extension of the more familiar Information Bottleneck, is a dimensionality reduction technique that simultaneously compresses two ran…