Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identification

Mohammed Maqsood Shaik, Dietrich Klakow, Badr M. Abdullah

Pre-trained Transformer-based speech models have shown striking performance when fine-tuned on various downstream tasks such as automatic speech recognition and spoken language ide…