A Compression Perspective on Simplicity Bias

Tom Marty, Eric Elmoznino, Leo Gagnon +5

Deep neural networks exhibit a simplicity bias, a well-documented tendency to favor simple functions over complex ones. In this work, we cast new light on this phenomenon through t…