MixtureGrowth: Growing Neural Networks by Recombining Learned Parameters

Chau Pham, Piotr Teterwak, Soren Nelson +1

Most deep neural networks are trained under fixed network architectures and require retraining when the architecture changes. If expanding the network's size is needed, it is neces…