GradMax: Growing Neural Networks using Gradient Information

Utku Evci, Bart van Merriënboer, Thomas Unterthiner +2

The architecture and the parameters of neural networks are often optimized independently, which requires costly retraining of the parameters whenever the architecture is modified.…