4 papers
Shallow Neural Networks Learn Low-Degree Spherical Polynomials with Feature Learning by Learnable Channel Attention
Yingzhen Yang
We study the problem of learning a low-degree spherical polynomial of degree defined on the unit sphere in $\RR^d$ by training an over-parameterized two-laye…
Improved Generalization Bounds for Transductive Learning by Transductive Local Complexity and Its Applications
Yingzhen Yang
We introduce Transductive Local Complexity (TLC) to extend the classical Local Rademacher Complexity (LRC) to the transductive setting, incorporating substantial and novel componen…
Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression
Yingzhen Yang, Ping Li
We study nonparametric regression by an over-parameterized two-layer neural network trained by gradient descent (GD) in this paper. We show that, if the neural network is trained b…
Sharp Generalization for Nonparametric Regression in Interpolation Space by Over-Parameterized Neural Networks Trained with Preconditioned Gradient Descent and Early Stopping
Yingzhen Yang, Ping Li
We study nonparametric regression using an over-parameterized two-layer neural networks trained with algorithmic guarantees in this paper. We consider the setting where the trainin…