Non-ergodic linear convergence property of the delayed gradient descent under the strongly convexity and the Polyak-Łojasiewicz condition

Hyung Jun Choi, Woocheol Choi, Jinmyoung Seok

In this work, we establish the linear convergence estimate for the gradient descent involving the delay $\tau \in \mathbb{N}$ when the cost function is $\mu$-strongly convex and $L$-smoot…