Sparse Polyak: an adaptive step size rule for high-dimensional M-estimation

Tianqi Qiao, Marie Maros

We propose and study Sparse Polyak, a variant of Polyak's adaptive step size, designed to solve high-dimensional statistical estimation problems where the problem dimension is allo…