Supervised and Self-supervised Pretraining Based COVID-19 Detection Using Acoustic Breathing/Cough/Speech Signals
arXiv:2201.08934 · doi:10.1109/ICASSP43922.2022.9746205
Abstract
In this work, we propose a bi-directional long short-term memory (BiLSTM) network based COVID-19 detection method using breath/speech/cough signals. By using the acoustic signals to train the network, respectively, we can build individual models for three tasks, whose parameters are averaged to obtain an average model, which is then used as the initialization for the BiLSTM model training of each task. This initialization method can significantly improve the performance on the three tasks, which surpasses the official baseline results. Besides, we also utilize a public pre-trained model wav2vec2.0 and pre-train it using the official DiCOVA datasets. This wav2vec2.0 model is utilized to extract high-level features of the sound as the model input to replace conventional mel-frequency cepstral coefficients (MFCC) features. Experimental results reveal that using high-level features together with MFCC features can improve the performance. To further improve the performance, we also deploy some preprocessing techniques like silent segment removal, amplitude normalization and time-frequency mask. The proposed detection model is evaluated on the DiCOVA dataset and results show that our method achieves an area under curve (AUC) score of 88.44% on blind test in the fusion track.
arXiv commentAccepted by ICASSP 2022
References in corpus (11)
- Adam: A Method for Stochastic Optimization
- Representation Learning with Contrastive Predictive Coding
- SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
- Categorical Reparameterization with Gumbel-Softmax
- Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data
- Coswara -- A Database of Breathing, Cough, and Voice Sounds for COVID-19 Diagnosis
- vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
- COVID-19 Cough Classification using Machine Learning and Global Smartphone Recordings
- A Review on Deep Learning Techniques for the Diagnosis of Novel Coronavirus (COVID-19)
- Unsupervised speech representation learning using WaveNet autoencoders
- Exploring Automatic COVID-19 Diagnosis via voice and symptoms from Crowdsourced Data