A Negative Result on Gradient Matching for Selective Backprop

Lukas Balles, Cedric Archambeau, Giovanni Zappella

With increasing scale in model and dataset size, the training of deep neural networks becomes a massive computational burden. One approach to speed up the training process is Selec…