Shallow Neural Networks Learn Low-Degree Spherical Polynomials with Feature Learning by Learnable Channel Attention

Yingzhen Yang

We study the problem of learning a low-degree spherical polynomial of degree ${\ell }_0=\Theta (1)\ge 1$ defined on the unit sphere in $\RR^d$ by training an over-parameterized two-layer…