2 papers
cs.LG2026
TalkLoRA: Communication-Aware Mixture of Low-Rank Adaptation for Large Language Models
Lin Mu, Haiyang Wang, Li Ni +4
Low-Rank Adaptation (LoRA) enables parameter-efficient fine-tuning of Large Language Models (LLMs), and recent Mixture-of-Experts (MoE) extensions further enhance flexibility by dy…
cs.CL2025
DenseLoRA: Dense Low-Rank Adaptation of Large Language Models
Lin Mu, Xiaoyu Wang, Li Ni +4
Low-rank adaptation (LoRA) has been developed as an efficient approach for adapting large language models (LLMs) by fine-tuning two low-rank matrices, thereby reducing the number o…