Adaptive Shared Experts with LoRA-Based Mixture of Experts for Multi-Task Learning

Minghao Yang, Ren Togo, Guang Li +2

Mixture-of-Experts (MoE) has emerged as a powerful framework for multi-task learning (MTL). However, existing MoE-MTL methods often rely on single-task pretrained backbones and suf…