A Probabilistic Representation of DNNs: Bridging Mutual Information and Generalization

Xinjie Lan, Kenneth Barner

Recently, Mutual Information (MI) has attracted attention in bounding the generalization error of Deep Neural Networks (DNNs). However, it is intractable to accurately estimate the…