Don't blame Dataset Shift! Shortcut Learning due to Gradients and Cross Entropy

Aahlad Puli, Lily Zhang, Yoav Wald +1

Common explanations for shortcut learning assume that the shortcut improves prediction under the training distribution but not in the test distribution. Thus, models trained via th…