3 papers
cs.LG2026
Sparsity, Superposition, and Forgetting: A Mechanistic Study of Representation Retention in Continual Learning
Jan Wasilewski, Jędrzej Kozal, Michał Woźniak +1
Continual learning (CL) systems often forget previously acquired knowledge, yet the mechanisms driving forgetting remain hard to isolate in practice because real datasets entangle…
cs.LG2025
What is the role of memorization in Continual Learning?
Jędrzej Kozal, Jan Wasilewski, Alif Ashrafee +2
Memorization impacts the performance of deep learning algorithms. Prior works have studied memorization primarily in the context of generalization and privacy. This work studies th…
cs.LG2024
Balanced Gradient Sample Retrieval for Enhanced Knowledge Retention in Proxy-based Continual Learning
Hongye Xu, Jan Wasilewski, Bartosz Krawczyk
Continual learning in deep neural networks often suffers from catastrophic forgetting, where representations for previous tasks are overwritten during subsequent training. We propo…