Overcoming Catastrophic Forgetting via Direction-Constrained Optimization

Yunfei Teng, Anna Choromanska, Murray Campbell +3

This paper studies a new design of the optimization algorithm for training deep learning models with a fixed architecture of the classification network in a continual learning fram…