Does Compression Imply Generalization? A Minimum Description Length Perspective

Lincen Yang, Jiayang Shi, Nan Pu +4

A central question in modern learning theory is what notion of compression, if any, explains why over-parameterized neural networks generalize. Existing answers measure complexity…