A Survey on LoRA of Large Language Models

Yuren Mao, Yuhang Ge, Yijiang Fan +4

Low-Rank Adaptation~(LoRA), which updates the dense neural network layers with pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning paradigms.…