Less is More: Resource-Efficient Low-Rank Adaptation

Chunlin Tian, Xuyang Wei, Huanrong Liu +2

Low-Rank Adaptation (LoRA) is a widely adopted parameter-efficient fine-tuning (PEFT) method for Large Language Models (LLMs), but it still incurs notable overhead and suffers from…