54 citations · 271 across the 20 of their papers we have counts for
Showing cs.ITShow all
2 papers · 1 filter
cs.IT2023
Generalized Information Bottleneck for Gaussian Variables
Vudtiwat Ngampruetikorn, David J. Schwab
The information bottleneck (IB) method offers an attractive framework for understanding representation learning, however its applications are often limited by its computational int…
cs.IT2022★ 1 cited
Information bottleneck theory of high-dimensional regression: relevancy, efficiency and optimality
Vudtiwat Ngampruetikorn, David J. Schwab
Avoiding overfitting is a central challenge in machine learning, yet many large neural networks readily achieve zero training loss. This puzzling contradiction necessitates new app…