On Leave-One-Out Conditional Mutual Information For Generalization

Mohamad Rida Rammal, Alessandro Achille, Aditya Golatkar +2

We derive information theoretic generalization bounds for supervised learning algorithms based on a new measure of leave-one-out conditional mutual information (loo-CMI). Contrary…