AlterSGD: Finding Flat Minima for Continual Learning by Alternative Training

Zhongzhan Huang, Mingfu Liang, Senwei Liang +1

Deep neural networks suffer from catastrophic forgetting when learning multiple knowledge sequentially, and a growing number of approaches have been proposed to mitigate this probl…