Overcoming Simplicity Bias in Deep Networks using a Feature Sieve

Rishabh Tiwari, Pradeep Shenoy

Simplicity bias is the concerning tendency of deep networks to over-depend on simple, weakly predictive features, to the exclusion of stronger, more complex features. This is exace…