Grokking Beyond the Euclidean Norm of Model Parameters

Pascal Jr Tikeng Notsawo, Guillaume Dumas, Guillaume Rabusseau

Grokking refers to a delayed generalization following overfitting when optimizing artificial neural networks with gradient-based methods. In this work, we demonstrate that grokking…