GradVis: Visualization and Second Order Analysis of Optimization Surfaces during the Training of Deep Neural Networks

Avraam Chatzimichailidis, Franz-Josef Pfreundt, Nicolas R. Gauger +1

Current training methods for deep neural networks boil down to very high dimensional and non-convex optimization problems which are usually solved by a wide range of stochastic gra…