Self-Normalized Resets for Plasticity in Continual Learning

Vivek F. Farias, Adam D. Jozefiak

Plasticity Loss is an increasingly important phenomenon that refers to the empirical observation that as a neural network is continually trained on a sequence of changing tasks, it…