Understanding Implicit Regularization in Over-Parameterized Single Index Model

Jianqing Fan, Zhuoran Yang, Mengxin Yu

In this paper, we leverage over-parameterization to design regularization-free algorithms for the high-dimensional single index model and provide theoretical guarantees for the ind…