Domain Expansion: Parameter-Efficient Modules as Building Blocks for Composite Domains

Mann Patel, Divyajyoti Panda, Hilay Mehta +2

Parameter-Efficient Fine-Tuning (PEFT) is an efficient alternative to full scale fine-tuning, gaining popularity recently. With pre-trained model sizes growing exponentially, PEFT…