Backpropagation through Back Substitution with a Backslash

Alan Edelman, Ekin Akyurek, Yuyang Wang

We present a linear algebra formulation of backpropagation which allows the calculation of gradients by using a generically written ``backslash'' or Gaussian elimination on triangu…