Remembering Transformer for Continual Learning

Yuwei Sun, Ippei Fujisawa, Arthur Juliani +2

Neural networks encounter the challenge of Catastrophic Forgetting (CF) in continual learning, where new task learning interferes with previously learned knowledge. Existing data f…