Porcupine Neural Networks: (Almost) All Local Optima are Global

Soheil Feizi, Hamid Javadi, Jesse Zhang +1

Neural networks have been used prominently in several machine learning and statistics applications. In general, the underlying optimization of neural networks is non-convex which m…