Low-Rank Adaptation with Task-Relevant Feature Enhancement for Fine-tuning Language Models

Changqun Li, Chaofan Ding, Kexin Luan +1

Fine-tuning pre-trained large language models in a parameter-efficient manner is widely studied for its effectiveness and efficiency. LoRA is one of the most widely used methods, w…