2 papers
cs.CV2023
Learning to Compose SuperWeights for Neural Parameter Allocation Search
Piotr Teterwak, Soren Nelson, Nikoli Dryden +3
Neural parameter allocation search (NPAS) automates parameter sharing by obtaining weights for a network given an arbitrary, fixed parameter budget. Prior work has two major drawba…
cs.LG2023
MixtureGrowth: Growing Neural Networks by Recombining Learned Parameters
Chau Pham, Piotr Teterwak, Soren Nelson +1
Most deep neural networks are trained under fixed network architectures and require retraining when the architecture changes. If expanding the network's size is needed, it is neces…