Reducing Catastrophic Forgetting in Online Class Incremental Learning Using Self-Distillation

Kotaro Nagata, Hiromu Ono, Kazuhiro Hotta

In continual learning, there is a serious problem of catastrophic forgetting, in which previous knowledge is forgotten when a model learns new tasks. Various methods have been prop…