READ: Recurrent Adaptation of Large Transformers

John Nguyen, Sid Wang, Ke Li +1

Fine-tuning large-scale Transformers has led to the explosion of many AI applications across Natural Language Processing and Computer Vision tasks. However, fine-tuning all pre-tra…