A note on $R$-linear convergence of nonmonotone gradient methods

Xinrui Li, Yakui Huang

Nonmonotone gradient methods generally perform better than their monotone counterparts especially on unconstrained quadratic optimization. However, the known convergence rate of th…