Parameter-Efficient Fine-Tuning With Adapters

Keyu Chen, Yuan Pang, Zi Yang

In the arena of language model fine-tuning, the traditional approaches, such as Domain-Adaptive Pretraining (DAPT) and Task-Adaptive Pretraining (TAPT), although effective, but com…