Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
The Grokked Illusion: True Equilibrium Mitigates Catastrophic Forgetting
Xiaotian Zhang, Lai Shun Chan, Yue Shang +2
While neural networks are typically evaluated by their training and test performance, these metrics do not reveal how robust a learned representation is. Recent studies have shown…
cs.LG2025
Is Grokking a Computational Glass Relaxation?
Xiaotian Zhang, Yue Shang, Entao Yang +1
Understanding neural network's (NN) generalizability remains a central question in deep learning research. The special phenomenon of grokking, where NNs abruptly generalize long af…
cs.LG2025
High-entropy Advantage in Neural Networks' Generalizability
Entao Yang, Xiaotian Zhang, Yue Shang +1
One of the central challenges in modern machine learning is understanding how neural networks generalize knowledge learned from training data to unseen test data. While numerous em…