Randomness and Interpolation Improve Gradient Descent

Jiawen Li, Pascal Lefevre, Anwar Pp Abdul Majeed

Based on Stochastic Gradient Descent (SGD), the paper introduces two optimizers, named Interpolational Accelerating Gradient Descent (IAGD) as well as Noise-Regularized Stochastic…