Showing 2025Show all
2 papers · 1 filter
cs.LG2025
Contrastive Predictive Coding Done Right for Mutual Information Estimation
J. Jon Ryu, Pavan Yeddanapudi, Xiangxiang Xu +1
The InfoNCE objective, originally introduced for contrastive representation learning, has become a popular choice for mutual information (MI) estimation, despite its indirect conne…
cs.IT2025
Separable Computation of Information Measures
Xiangxiang Xu, Lizhong Zheng
We study a separable design for computing information measures, where the information measure is computed from learned feature representations instead of raw data. Under mild assum…