Showing 2025Show all
2 papers · 1 filter
cs.CL2025
LD-MoLE: Learnable Dynamic Routing for Mixture of LoRA Experts
Yuan Zhuang, Yi Shen, Yuexin Bian +4
Recent studies have shown that combining parameter-efficient fine-tuning (PEFT) with mixture-of-experts (MoE) is an effective strategy for adapting large language models (LLMs) to…
cs.LG2025
Uni-LoRA: One Vector is All You Need
Kaiyang Li, Shaobo Han, Qing Su +3
Low-Rank Adaptation (LoRA) has become the de facto parameter-efficient fine-tuning (PEFT) method for large language models (LLMs) by constraining weight updates to low-rank matrice…