Surfing: Iterative optimization over incrementally trained deep networks

Ganlin Song, Zhou Fan, John Lafferty

We investigate a sequential optimization procedure to minimize the empirical risk functional $f_{\hat{\theta }}(x)=\frac{1}{2}\Vert G_{\hat{\theta }}(x)-y{\Vert }^2$ for certain families of deep network…