Neural Velocity for hyperparameter tuning

Gianluca Dalmasso, Andrea Bragagnolo, Enzo Tartaglione +2

Hyperparameter tuning, such as learning rate decay and defining a stopping criterion, often relies on monitoring the validation loss. This paper presents NeVe, a dynamic training a…