Continual Learning With Quasi-Newton Methods

Steven Vander Eeckt, Hugo Van hamme

Catastrophic forgetting remains a major challenge when neural networks learn tasks sequentially. Elastic Weight Consolidation (EWC) attempts to address this problem by introducing…