On the Quality of the Initial Basin in Overspecified Neural Networks

Itay Safran, Ohad Shamir

Deep learning, in the form of artificial neural networks, has achieved remarkable practical success in recent years, for a variety of difficult machine learning applications. Howev…