Random Representations Outperform Online Continually Learned Representations

Ameya Prabhu, Shiven Sinha, Ponnurangam Kumaraguru +3

Continual learning has primarily focused on the issue of catastrophic forgetting and the associated stability-plasticity tradeoffs. However, little attention has been paid to the e…