Beyond Backpropagation: Monte Carlo Method Can Train Deep Neural Networks

Hong Zhao

Backpropagation (BP) dominates deep learning training, but its reliance on gradients brings inherent troubles -- vanishing and exploding gradients. The pursuit of gradient-free met…