Spectral Dependence of Convex Regularization: Fundamental Limits under Right-Rotationally Invariant Designs

Baichen Tan, Audrey Yang, Cynthia Rush

We study the fundamental limits of convex-regularized estimation in high-dimensional linear regression with right-rotationally invariant design matrices. We show that the asymptoti…