Sparse Autoencoders Can Induce Local Geometry for Mitigating Catastrophic Forgetting

Kamil Faber, Katarzyna Filus, Łukasz Pawela

Catastrophic forgetting remains a challenge in supervised continual learning, as adapting to new tasks causes representation drift and loss of previously learned information. This…