Uni-LoRA: One Vector is All You Need

Kaiyang Li, Shaobo Han, Qing Su +3

Low-Rank Adaptation (LoRA) has become the de facto parameter-efficient fine-tuning (PEFT) method for large language models (LLMs) by constraining weight updates to low-rank matrice…