Cross-lingual Transfer for Speech Processing using Acoustic Language Similarity
arXiv:2111.01326
Abstract
Speech processing systems currently do not support the vast majority of languages, in part due to the lack of data in low-resource languages. Cross-lingual transfer offers a compelling way to help bridge this digital divide by incorporating high-resource data into low-resource systems. Current cross-lingual algorithms have shown success in text-based tasks and speech-related tasks over some low-resource languages. However, scaling up speech systems to support hundreds of low-resource languages remains unsolved. To help bridge this gap, we propose a language similarity approach that can efficiently identify acoustic cross-lingual transfer pairs across hundreds of languages. We demonstrate the effectiveness of our approach in language family classification, speech recognition, and speech synthesis tasks.
References in corpus (7)
- SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
- VoxCeleb: a large-scale speaker identification dataset
- A Comparative Study on Transformer vs RNN in Speech Applications
- Conformer: Convolution-augmented Transformer for Speech Recognition
- MLS: A Large-Scale Multilingual Dataset for Speech Research
- GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio
- Automatically Identifying Language Family from Acoustic Examples in Low Resource Scenarios