paper

A Stochastic Gradient Descent Theorem and the Back-Propagation Algorithm

arXiv:2104.00539

Abstract

We establish a convergence theorem for a certain type of stochastic gradient descent, which leads to a convergent variant of the back-propagation algorithm

15 pages, 1 figure

A Stochastic Gradient Descent Theorem and the Back-Propagation Algorithm · wovepaper