Annihilation of Spurious Minima in Two-Layer ReLU Networks

Yossi Arjevani, Michael Field

We study the optimization problem associated with fitting two-layer ReLU neural networks with respect to the squared loss, where labels are generated by a target network. Use is ma…