Self-Supervised Learning for speech recognition with Intermediate layer supervision

Chengyi Wang, Yu Wu, Sanyuan Chen +4

Recently, pioneer work finds that speech pre-trained models can solve full-stack speech processing tasks, because the model utilizes bottom layers to learn speaker-related informat…