Training Neural Networks with an algorithm for piecewise linear functions
arXiv:2105.06503
Abstract
We present experiments on training neural networks with an algorithm that was originally designed as a subgradient method, namely the Volume Algorithm. We compare with two of the most frequently used algorithms like Momentum and Adam. We also compare with the newly proposed algorithm COCOB.