Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
NLoRA: Nyström-Initiated Low-Rank Adaptation for Large Language Models
Chenlu Guo, Yuan Wu, Yi Chang
Parameter-efficient fine-tuning (PEFT) is essential for adapting large language models (LLMs), with low-rank adaptation (LoRA) being the most popular approach. However, LoRA suffer…
cs.CL2025
LoRA-MGPO: Mitigating Double Descent in Low-Rank Adaptation via Momentum-Guided Perturbation Optimization
Yupeng Chang, Chenlu Guo, Yi Chang +1
Parameter-efficient fine-tuning (PEFT), particularly Low-Rank Adaptation (LoRA), adapts large language models (LLMs) by training only a small fraction of parameters. However, as th…