Improving speech recognition models with small samples for air traffic control systems

Abstract

In the domain of air traffic control (ATC) systems, efforts to train a practical automatic speech recognition (ASR) model always faces the problem of small training samples since the collection and annotation of speech samples are expert- and domain-dependent task. In this work, a novel training approach based on pretraining and transfer learning is proposed to address this issue, and an improved end-to-end deep learning model is developed to address the specific challenges of ASR in the ATC domain. An unsupervised pretraining strategy is first proposed to learn speech representations from unlabeled samples for a certain dataset. Specifically, a masking strategy is applied to improve the diversity of the sample without losing their general patterns. Subsequently, transfer learning is applied to fine-tune a pretrained or other optimized baseline models to finally achieves the supervised ASR task. By virtue of the common terminology used in the ATC domain, the transfer learning task can be regarded as a sub-domain adaption task, in which the transferred model is optimized using a joint corpus consisting of baseline samples and new transcribed samples from the target dataset. This joint corpus construction strategy enriches the size and diversity of the training samples, which is important for addressing the issue of the small transcribed corpus. In addition, speed perturbation is applied to augment the new transcribed samples to further improve the quality of the speech corpus. Three real ATC datasets are used to validate the proposed ASR model and training strategies. The experimental results demonstrate that the ASR performance is significantly improved on all three datasets, with an absolute character error rate only one-third of that achieved through the supervised training. The applicability of the proposed strategies to other ASR approaches is also validated.

This work has been accepted by Neurocomputing for publication

References in corpus (11)

• Efficient Estimation of Word Representations in Vector Space
• How transferable are features in deep neural networks?
• Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
• XLNet: Generalized Autoregressive Pretraining for Language Understanding
• Cross-lingual Language Model Pretraining
• ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
• Data-Efficient Image Recognition with Contrastive Predictive Coding
• vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
• The Airbus Air Traffic Control speech recognition 2018 challenge: towards ATC automatic transcription and call sign detection
• Pre-trained Language Model Representations for Language Generation
• Improving speech emotion recognition via Transformer-based Predictive Coding through transfer learning