ELRA: Exponential learning rate adaption gradient descent optimization method

Alexander Kleinsorge, Stefan Kupper, Alexander Fauck +1

We present a novel, fast (exponential rate adaption), ab initio (hyper-parameter-free) gradient based optimizer algorithm. The main idea of the method is to adapt the learning rate…