Sparsity, Superposition, and Forgetting: A Mechanistic Study of Representation Retention in Continual Learning

Jan Wasilewski, Jędrzej Kozal, Michał Woźniak +1

Continual learning (CL) systems often forget previously acquired knowledge, yet the mechanisms driving forgetting remain hard to isolate in practice because real datasets entangle…