Geometry of energy landscapes and the optimizability of deep neural networks

Simon Becker, Yao Zhang, Alpha A. Lee

Deep neural networks are workhorse models in machine learning with multiple layers of non-linear functions composed in series. Their loss function is highly non-convex, yet empiric…