Balanced softmax cross-entropy for incremental learning with and without memory

Quentin Jodelet, Xin Liu, Tsuyoshi Murata

When incrementally trained on new classes, deep neural networks are subject to catastrophic forgetting which leads to an extreme deterioration of their performance on the old class…