Shared-Weights Extender and Gradient Voting for Neural Network Expansion

Nikolas Chatzis, Ioannis Kordonis, Manos Theodosis +1

Expanding neural networks during training is a promising way to augment capacity without retraining larger models from scratch. However, newly added neurons often fail to adjust to…