2 papers
cs.CL2025
Mixture of Routers
Jia-Chen Zhang, Yu-Jie Xiong, Xi-He Qiu +3
Supervised fine-tuning (SFT) is a milestone in aligning large language models with human instructions and adapting them to downstream tasks. In particular, Low-Rank Adaptation (LoR…
cs.CL2025
Parameter-Efficient Fine-Tuning of Large Language Models via Deconvolution in Subspace
Jia-Chen Zhang, Yu-Jie Xiong, Chun-Ming Xia +2
Large language model (LLM) is considered a milestone towards achieving Artificial General Intelligence (AGI). With its advanced emergent capabilities, it adapt to a wide range of s…