Sparse Polyak with optimal thresholding operators for high-dimensional M-estimation

Tianqi Qiao, Marie Maros

We propose and analyze a variant of Sparse Polyak for high dimensional M-estimation problems. Sparse Polyak proposes a novel adaptive step-size rule tailored to suitably estimate t…