To Raise or Not To Raise: The Autonomous Learning Rate Question

Xiaomeng Dong, Tao Tan, Michael Potter +4

There is a parameter ubiquitous throughout the deep learning world: learning rate. There is likewise a ubiquitous question: what should that learning rate be? The true answer to th…