Lyapunov Analysis For Monotonically Forward-Backward Accelerated Algorithms

Mingwei Fu, Bin Shi

Nesterov's accelerated gradient method (NAG) achieves faster convergence than gradient descent for convex optimization but lacks monotonicity in function values. To address this, B…