Geometry-dependent matching pursuit: a transition phase for convergence on linear regression and LASSO

Céline Moucer, Adrien Taylor, Francis Bach

Greedy first-order methods, such as coordinate descent with Gauss-Southwell rule or matching pursuit, have become popular in optimization due to their natural tendency to propose s…