1 citations · 1 across the 9 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Polynomial Expansion Rank Adaptation: Enhancing Low-Rank Fine-Tuning with High-Order Interactions
Wenhao Zhang, Lin Mu, Li Ni +2
Low-rank adaptation (LoRA) is a widely used strategy for efficient fine-tuning of large language models (LLMs), but its strictly linear structure fundamentally limits expressive ca…
cs.LG2026
TalkLoRA: Communication-Aware Mixture of Low-Rank Adaptation for Large Language Models
Lin Mu, Haiyang Wang, Li Ni +4
Low-Rank Adaptation (LoRA) enables parameter-efficient fine-tuning of Large Language Models (LLMs), and recent Mixture-of-Experts (MoE) extensions further enhance flexibility by dy…