Diagnosing Catastrophe: Large parts of accuracy loss in continual learning can be accounted for by readout misalignment

Daniel Anthes, Sushrut Thorat, Peter König +1

Unlike primates, training artificial neural networks on changing data distributions leads to a rapid decrease in performance on old tasks. This phenomenon is commonly referred to a…