Reinforcement Learning for Learning Rate Control

Chang Xu, Tao Qin, Gang Wang +1

Stochastic gradient descent (SGD), which updates the model parameters by adding a local gradient times a learning rate at each step, is widely used in model training of machine lea…