Removing spurious minima for planar features by skip connections

Jakob Paul Zimmermann, Moritz Grillo, Andrei Balakin +1

Understanding loss landscapes is central to explaining neural-network training, yet their structure remains only partially understood even in simple models. We study the Gaussian p…