Gradients without Backpropagation

Atılım Güneş Baydin, Barak A. Pearlmutter, Don Syme +2

Using backpropagation to compute gradients of objective functions for optimization has remained a mainstay of machine learning. Backpropagation, or reverse-mode differentiation, is…