Gradient Correction beyond Gradient Descent

Zefan Li, Bingbing Ni, Teng Li +2

The great success neural networks have achieved is inseparable from the application of gradient-descent (GD) algorithms. Based on GD, many variant algorithms have emerged to improv…