Connecting Jensen-Shannon and Kullback-Leibler Divergences: A New Bound for Representation Learning

Reuben Dorent, Polina Golland, William Wells

Mutual Information (MI) is a fundamental measure of statistical dependence widely used in representation learning. While direct optimization of MI via its definition as a Kullback-…