Projected Subnetworks Scale Adaptation

Siddhartha Datta, Nigel Shadbolt

Large models support great zero-shot and few-shot capabilities. However, updating these models on new tasks can break performance on previous seen tasks and their zero/few-shot uns…