On the Cardinality of Optimal Representations in the Binary-Source Information Bottleneck

Dier Tang, Jun Chen

The information bottleneck (IB) seeks a representation $U$ of a source $X$ that retains as much information as possible about a target $Y$, subject to a constraint on $I(U;X)$. A c…