From Weights to Features: SAE-Guided Activation Regularization for LLM Continual Learning

Evan Ning, Wei Xue, Dong Lou +1

Weight-space regularization methods such as Elastic Weight Consolidation (EWC) are the standard approach to catastrophic forgetting in continual learning. However, those methods te…