127 citations · 193 across the 15 of their papers we have counts for
8 papers · 1 filter
Update Your Transformer to the Latest Release: Re-Basin of Task Vectors
Filippo Rinaldi, Giacomo Capitani, Lorenzo Bonicelli +6
Foundation models serve as the backbone for numerous specialized models developed through fine-tuning. However, when the underlying pretrained model is updated or retrained (e.g.,…
May the Forgetting Be with You: Alternate Replay for Learning with Noisy Labels
Monica Millunzi, Lorenzo Bonicelli, Angelo Porrello +3
Forgetting presents a significant challenge during incremental training, making it particularly demanding for contemporary AI systems to assimilate new knowledge in streaming data…
Semantic Residual Prompts for Continual Learning
Martin Menabue, Emanuele Frascaroli, Matteo Boschini +4
Prompt-tuning methods for Continual Learning (CL) freeze a large pre-trained model and train a few parameter vectors termed prompts. Most of these methods organize these vectors in…
On the Effectiveness of Equivariant Regularization for Robust Online Continual Learning
Lorenzo Bonicelli, Matteo Boschini, Emanuele Frascaroli +6
Humans can learn incrementally, whereas neural networks forget previously acquired information catastrophically. Continual Learning (CL) approaches seek to bridge this gap by facil…
On the Effectiveness of Lipschitz-Driven Rehearsal in Continual Learning
Lorenzo Bonicelli, Matteo Boschini, Angelo Porrello +2
Rehearsal approaches enjoy immense popularity with Continual Learning (CL) practitioners. These methods collect samples from previously encountered data distributions in a small me…
Transfer without Forgetting
Matteo Boschini, Lorenzo Bonicelli, Angelo Porrello +5
This work investigates the entanglement between Continual Learning (CL) and Transfer Learning (TL). In particular, we shed light on the widespread application of network pretrainin…
Effects of Auxiliary Knowledge on Continual Learning
Giovanni Bellitto, Matteo Pennisi, Simone Palazzo +4
In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information…
Class-Incremental Continual Learning into the eXtended DER-verse
Matteo Boschini, Lorenzo Bonicelli, Pietro Buzzega +2
The staple of human intelligence is the capability of acquiring knowledge in a continuous fashion. In stark contrast, Deep Networks forget catastrophically and, for this reason, th…