Overcoming Multi-Model Forgetting

Yassine Benyahia, Kaicheng Yu, Kamil Bennani-Smires +4

We identify a phenomenon, which we refer to as multi-model forgetting, that occurs when sequentially training multiple deep networks with partially-shared parameters; the performan…