How Does Gradient Descent Learn Features -- A Local Analysis for Regularized Two-Layer Neural Networks

Mo Zhou, Rong Ge

The ability of learning useful features is one of the major advantages of neural networks. Although recent works show that neural network can operate in a neural tangent kernel (NT…