13 citations · 43 across the 10 of their papers we have counts for
4 papers · 1 filter
On Distributed Learning with Constant Communication Bits
Xiangxiang Xu, Shao-Lun Huang
In this paper, we study a distributed learning problem constrained by constant communication bits. Specifically, we consider the distributed hypothesis testing (DHT) problem where…
An Information-theoretic Approach to Unsupervised Feature Selection for High-Dimensional Data
Shao-Lun Huang, Xiangxiang Xu, Lizhong Zheng
In this paper, we propose an information-theoretic approach to design the functional representations to extract the hidden common structure shared by a set of random variables. The…
On the Sample Complexity of HGR Maximal Correlation Functions for Large Datasets
Shao-Lun Huang, Xiangxiang Xu
The Hirschfeld-Gebelein-Rényi (HGR) maximal correlation and the corresponding functions have been shown useful in many machine learning scenarios. In this paper, we study the sampl…
An Information Theoretic Interpretation to Deep Neural Networks
Shao-Lun Huang, Xiangxiang Xu, Lizhong Zheng +1
It is commonly believed that the hidden layers of deep neural networks (DNNs) attempt to extract informative features for learning tasks. In this paper, we formalize this intuition…