When does Bias Transfer in Transfer Learning?

Hadi Salman, Saachi Jain, Andrew Ilyas +3

Using transfer learning to adapt a pre-trained "source model" to a downstream "target task" can dramatically increase performance with seemingly no downside. In this work, we demon…