Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition

Ye Bai, Jie Li, Wenjing Han +5

While transformers and their variant conformers show promising performance in speech recognition, the parameterized property leads to much memory cost during training and inference…