Trained Models Tell Us How to Make Them Robust to Spurious Correlation without Group Annotation

Mahdi Ghaznavi, Hesam Asadollahzadeh, Fahimeh Hosseini Noohdani +5

Classifiers trained with Empirical Risk Minimization (ERM) tend to rely on attributes that have high spurious correlation with the target. This can degrade the performance on under…