Local minima in training of neural networks

Grzegorz Swirszcz, Wojciech Marian Czarnecki, Razvan Pascanu

There has been a lot of recent interest in trying to characterize the error surface of deep models. This stems from a long standing question. Given that deep networks are highly no…