Keep Moving: identifying task-relevant subspaces to maximise plasticity for newly learned tasks

Daniel Anthes, Sushrut Thorat, Peter König +1

Continual learning algorithms strive to acquire new knowledge while preserving prior information. Often, these algorithms emphasise stability and restrict network updates upon lear…