Densely Distilling Cumulative Knowledge for Continual Learning

Zenglin Shi, Pei Liu, Tong Su +4

Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in pr…