Is Last Layer Re-Training Truly Sufficient for Robustness to Spurious Correlations?

Phuong Quynh Le, Jörg Schlötterer, Christin Seifert

Models trained with empirical risk minimization (ERM) are known to learn to rely on spurious features, i.e., their prediction is based on undesired auxiliary features which are str…