Low-redundancy Distillation for Continual Learning

RuiQi Liu, Boyu Diao, Libo Huang +4

Continual learning (CL) aims to learn new tasks without erasing previous knowledge. However, current CL methods primarily emphasize improving accuracy while often neglecting traini…