2 papers
cs.LG2024
Mutual Information Multinomial Estimation
Yanzhi Chen, Zijing Ou, Adrian Weller +1
Estimating mutual information (MI) is a fundamental yet challenging task in data science and machine learning. This work proposes a new estimator for mutual information. Our main d…
stat.ML2023
Training Discrete Energy-Based Models with Energy Discrepancy
Tobias Schröder, Zijing Ou, Yingzhen Li +1
Training energy-based models (EBMs) on discrete spaces is challenging because sampling over such spaces can be difficult. We propose to train discrete EBMs with energy discrepancy…