Reducing the Need for Backpropagation and Discovering Better Optima With Explicit Optimizations of Neural Networks

Jake Ryland Williams, Haoran Zhao

Iterative differential approximation methods that rely upon backpropagation have enabled the optimization of neural networks; however, at present, they remain computationally expen…