An Infinite-Width Analysis on the Jacobian-Regularised Training of a Neural Network

Taeyoung Kim, Hongseok Yang

The recent theoretical analysis of deep neural networks in their infinite-width limits has deepened our understanding of initialisation, feature learning, and training of those net…