Feature contamination: Neural networks learn uncorrelated features and fail to generalize

Tianren Zhang, Chujie Zhao, Guanyu Chen +2

Learning representations that generalize under distribution shifts is critical for building robust machine learning models. However, despite significant efforts in recent years, al…