Loss Smoothing for Stable Adaptation Under Distribution Shift

Darshan Patil, Ekaterina Lobacheva, Razvan Pascanu +1

In settings such as fine-tuning and reinforcement learning, neural networks are often adapted under distribution shift. Standard adaptation methods typically optimize the target ob…