LoRALib: A Standardized Benchmark for Evaluating LoRA-MoE Methods

Shaoheng Wang, Yao Lu, Yuqi Li +5

As a parameter efficient fine-tuning (PEFT) method, low-rank adaptation (LoRA) can save significant costs in storage and computing, but its strong adaptability to a single task is…