Revisiting Softmax Masking: Stop Gradient for Enhancing Stability in Replay-based Continual Learning

Hoyong Kim, Minchan Kwon, Kangil Kim

In replay-based methods for continual learning, replaying input samples in episodic memory has shown its effectiveness in alleviating catastrophic forgetting. However, the potentia…