Continual evaluation for lifelong learning: Identifying the stability gap

Matthias De Lange, Gido van de Ven, Tinne Tuytelaars

Time-dependent data-generating distributions have proven to be difficult for gradient-based training of neural networks, as the greedy updates result in catastrophic forgetting of…