Spurious Local Minima of Deep ReLU Neural Networks in the Neural Tangent Kernel Regime

Tohru Nitta

In this paper, we theoretically prove that the deep ReLU neural networks do not lie in spurious local minima in the loss landscape under the Neural Tangent Kernel (NTK) regime, tha…