Canonical Regularisation of Wide Feature-Learning Neural Networks

George Whittle, Pranav Vaidhyanathan, Juliusz Ziomek +2

Wide neural networks in the feature-learning regime drive modern deep learning, and yet they remain far less studied than their kernel-regime counterparts. We consider a critical y…