4 papers · 1 filter
Efficient Solvers for Wyner Common Information with Application to Multi-Modal Clustering
Teng-Hui Huang, Hesham El Gamal
We propose two novel extensions of the Wyner common information optimization problem. Each relaxes one fundamental constraints in Wyner's formulation. The \textit{Variational Wyner…
Efficient Alternating Minimization Solvers for Wyner Multi-View Unsupervised Learning
Teng-Hui Huang, Hesham El Gamal
In this work, we adopt Wyner common information framework for unsupervised multi-view representation learning. Within this framework, we propose two novel formulations that enable…
A Linearly Convergent Douglas-Rachford Splitting Solver for Markovian Information-Theoretic Optimization Problems
Teng-Hui Huang, Aly El Gamal, Hesham El Gamal
In this work, we propose solving the Information bottleneck (IB) and Privacy Funnel (PF) problems with Douglas-Rachford Splitting methods (DRS). We study a general Markovian inform…
On the Multi-View Information Bottleneck Representation
Teng-Hui Huang, Aly El Gamal, Hesham El Gamal
In this work, we generalize the information bottleneck (IB) approach to the multi-view learning context. The exponentially growing complexity of the optimal representation motivate…