8 citations · 25 across the 17 of their papers we have counts for
4 papers · 1 filter
LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugin
Shihan Dou, Enyu Zhou, Yan Liu +13
Supervised fine-tuning (SFT) is a crucial step for large language models (LLMs), enabling them to align with human instructions and enhance their capabilities in downstream tasks.…
Loose lips sink ships: Mitigating Length Bias in Reinforcement Learning from Human Feedback
Wei Shen, Rui Zheng, Wenyu Zhan +5
Reinforcement learning from human feedback serves as a crucial bridge, aligning large language models with human and societal values. This alignment requires a vast corpus of human…
Unveiling A Core Linguistic Region in Large Language Models
Jun Zhao, Zhihao Zhang, Yide Ma +4
Brain localization, which describes the association between specific regions of the brain and their corresponding functions, is widely accepted in the field of cognitive science as…
Towards Domain-Specific Features Disentanglement for Domain Generalization
Hao Chen, Qi Zhang, Zenan Huang +2
Distributional shift between domains poses great challenges to modern machine learning algorithms. The domain generalization (DG) signifies a popular line targeting this issue, whe…