Predicting When Random Low-Dimensional Reparameterizations Train Neural Networks

Andrew Cheng, Ali Eslamian, Jie Cheng +2

Neural networks can often be trained or fine-tuned through random low-dimensional reparameterization, where a small latent vector is mapped into a full parameter update by a frozen…