15 citations · 15 across the 2 of their papers we have counts for
2 papers
cs.LG2023★ 15 cited
How Does Information Bottleneck Help Deep Learning?
Kenji Kawaguchi, Zhun Deng, Xu Ji +1
Numerous deep learning algorithms have been inspired by and understood via the notion of information bottleneck, where unnecessary information is (often implicitly) minimized while…
cs.LG2021
Properties of Minimizing Entropy
Xu Ji, Lena Nehale-Ezzine, Maksym Korablyov
Compact data representations are one approach for improving generalization of learned functions. We explicitly illustrate the relationship between entropy and cardinality, both mea…