78 citations · 191 across the 19 of their papers we have counts for
3 papers · 1 filter
A Negative Result on Gradient Matching for Selective Backprop
Lukas Balles, Cedric Archambeau, Giovanni Zappella
With increasing scale in model and dataset size, the training of deep neural networks becomes a massive computational burden. One approach to speed up the training process is Selec…
Continual Learning with Low Rank Adaptation
Martin Wistuba, Prabhu Teja Sivaprasad, Lukas Balles +1
Recent work using pretrained transformers has shown impressive performance when fine-tuned with data from the downstream problem of interest. However, they struggle to retain that…
Renate: A Library for Real-World Continual Learning
Martin Wistuba, Martin Ferianc, Lukas Balles +2
Continual learning enables the incremental training of machine learning models on non-stationary data streams.While academic interest in the topic is high, there is little indicati…