MLP Fusion: Towards Efficient Fine-tuning of Dense and Mixture-of-Experts Language Models

Mengting Ai, Tianxin Wei, Yifan Chen +2