On the energy landscape of deep networks

Pratik Chaudhari, Stefano Soatto

We introduce "AnnealSGD", a regularized stochastic gradient descent algorithm motivated by an analysis of the energy landscape of a particular class of deep networks with sparse ra…