Deep Learning Theory through the Lens of Statistical Physics: A Topical Review

Wei Huang, Youjin Deng

The recent success of foundation models and deep learning has far outpaced our theoretical understanding of how large-scale neural networks learn and generalize. Statistical physic…