A Theoretical View of Linear Backpropagation and Its Convergence

Ziang Li, Yiwen Guo, Haodi Liu +1

Backpropagation (BP) is widely used for calculating gradients in deep neural networks (DNNs). Applied often along with stochastic gradient descent (SGD) or its variants, BP is cons…