Dynamic Estimation of Learning Rates Using a Non-Linear Autoregressive Model

Ramin Okhrati

We introduce a new class of adaptive non-linear autoregressive (Nlar) models incorporating the concept of momentum, which dynamically estimate both the learning rates and momentum…