Side-Tuning: A Baseline for Network Adaptation via Additive Side Networks

Jeffrey O Zhang, Alexander Sax, Amir Zamir +2

When training a neural network for a desired task, one may prefer to adapt a pre-trained network rather than starting from randomly initialized weights. Adaptation can be useful in…