Beyond Distribution Shift: Spurious Features Through the Lens of Training Dynamics

Nihal Murali, Aahlad Puli, Ke Yu +2

Deep Neural Networks (DNNs) are prone to learning spurious features that correlate with the label during training but are irrelevant to the learning problem. This hurts model gener…