Ranger21: a synergistic deep learning optimizer

Less Wright, Nestor Demeure

As optimizers are critical to the performances of neural networks, every year a large number of papers innovating on the subject are published. However, while most of these publica…