NoProp: Training Neural Networks without Full Back-propagation or Full Forward-propagation

Qinyu Li, Yee Whye Teh, Razvan Pascanu

The canonical deep learning approach for learning requires computing a gradient term at each block by back-propagating the error signal from the output towards each learnable param…