Mean-Field Analysis for Learning Subspace-Sparse Polynomials with Gaussian Input

Ziang Chen, Rong Ge

In this work, we study the mean-field flow for learning subspace-sparse polynomials using stochastic gradient descent and two-layer neural networks, where the input distribution is…