PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation

Nadav Benedek, Lior Wolf

With the proliferation of large pre-trained language models (PLMs), fine-tuning all model parameters becomes increasingly inefficient, particularly when dealing with numerous downs…