Showing 2023Show all
2 papers · 1 filter
cs.LG2023
Diagnosing Catastrophe: Large parts of accuracy loss in continual learning can be accounted for by readout misalignment
Daniel Anthes, Sushrut Thorat, Peter König +1
Unlike primates, training artificial neural networks on changing data distributions leads to a rapid decrease in performance on old tasks. This phenomenon is commonly referred to a…
cs.LG2023
Keep Moving: identifying task-relevant subspaces to maximise plasticity for newly learned tasks
Daniel Anthes, Sushrut Thorat, Peter König +1
Continual learning algorithms strive to acquire new knowledge while preserving prior information. Often, these algorithms emphasise stability and restrict network updates upon lear…