UME: Upcycling Mixture-of-Experts for Scalable and Efficient Automatic Speech Recognition

Li Fu, Shanyong Yu, Siqi Li +3

Recent advancements in scaling up models have significantly improved performance in Automatic Speech Recognition (ASR) tasks. However, training large ASR models from scratch remain…