On architectural choices in deep learning: From network structure to gradient convergence and parameter estimation

Vamsi K Ithapu, Sathya N Ravi, Vikas Singh

We study mechanisms to characterize how the asymptotic convergence of backpropagation in deep architectures, in general, is related to the network structure, and how it may be infl…