Jointly Reparametrized Multi-Layer Adaptation for Efficient and Private Tuning

Umang Gupta, Aram Galstyan, Greg Ver Steeg

Efficient finetuning of pretrained language transformers is becoming increasingly prevalent for solving natural language processing tasks. While effective, it can still require a l…