An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent

Zhao Song, Chiwun Yang

The delta-bar-delta algorithm is recognized as a learning rate adaptation technique that enhances the convergence speed of the training process in optimization by dynamically sched…