Mean-Field Analysis of Two-Layer Neural Networks: Global Optimality with Linear Convergence Rates

Jingwei Zhang, Xunpeng Huang, Jincheng Yu

We consider optimizing two-layer neural networks in the mean-field regime where the learning dynamics of network weights can be approximated by the evolution in the space of probab…