The Grokked Illusion: True Equilibrium Mitigates Catastrophic Forgetting

Xiaotian Zhang, Lai Shun Chan, Yue Shang +2

While neural networks are typically evaluated by their training and test performance, these metrics do not reveal how robust a learned representation is. Recent studies have shown…