AdaGrad-Diff: A New Version of the Adaptive Gradient Algorithm

Matia Bojovic, Saverio Salzo, Massimiliano Pontil

Vanilla gradient methods are often highly sensitive to the choice of stepsize, which typically requires manual tuning. Adaptive methods alleviate this issue and have therefore beco…