How iteration order influences convergence and stability in deep learning

Benoit Dherin, Benny Avelin, Anders Karlsson +3

Despite exceptional achievements, training neural networks remains computationally expensive and is often plagued by instabilities that can degrade convergence. While learning rate…