PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization

Xiangdi Meng, Damai Dai, Weiyao Luo +7

Supervised fine-tuning is the most common method to adapt large language models (LLMs) to downstream tasks, but full fine-tuning LLMs requires massive computational resources. Rece…