A second-order-like optimizer with adaptive gradient scaling for deep learning

Jérôme Bolte, Ryan Boustany, Edouard Pauwels +1

In this empirical article, we introduce INNAprop, an optimization algorithm that combines the INNA method with the RMSprop adaptive gradient scaling. It leverages second-order info…