On the Omnipresence of Spurious Local Minima in Certain Neural Network Training Problems

Constantin Christof, Julia Kowalczyk

We study the loss landscape of training problems for deep artificial neural networks with a one-dimensional real output whose activation functions contain an affine segment and who…