Gradient Episodic Memory with a Soft Constraint for Continual Learning

Guannan Hu, Wu Zhang, Hu Ding +1

Catastrophic forgetting in continual learning is a common destructive phenomenon in gradient-based neural networks that learn sequential tasks, and it is much different from forget…