Convergence of backpropagation with momentum for network architectures with skip connections

Chirag Agarwal, Joe Klobusicky, Dan Schonfeld

We study a class of deep neural networks with networks that form a directed acyclic graph (DAG). For backpropagation defined by gradient descent with adaptive momentum, we show wei…