Null-LoRA: Low-Rank Adaptation on Null Space

Yi Zhang, Yulei Kang, Haoxuan Chen +2

Parameter-efficient fine-tuning methods have gained considerable popularity for adapting large-scale models to downstream tasks, particularly LoRA and its variants. Existing method…