LocalProp: Neuro-Localized Memory-Efficient Backpropagation

Diana-Nicoleta Grigore, Iuliana Georgescu, Radu Tudor Ionescu

The current deep learning training paradigm employs end-to-end backpropagation, regardless of the training stage, i.e. pre-training or fine-tuning. However, backpropagating through…