Exploring Self-Supervised Representation Ensembles for COVID-19 Cough Classification

Abstract

The usage of smartphone-collected respiratory sound, trained with deep learning models, for detecting and classifying COVID-19 becomes popular recently. It removes the need for in-person testing procedures especially for rural regions where related medical supplies, experienced workers, and equipment are limited. However, existing sound-based diagnostic approaches are trained in a fully supervised manner, which requires large scale well-labelled data. It is critical to discover new methods to leverage unlabelled respiratory data, which can be obtained more easily. In this paper, we propose a novel self-supervised learning enabled framework for COVID-19 cough classification. A contrastive pre-training phase is introduced to train a Transformer-based feature encoder with unlabelled data. Specifically, we design a random masking mechanism to learn robust representations of respiratory sounds. The pre-trained feature encoder is then fine-tuned in the downstream phase to perform cough classification. In addition, different ensembles with varied random masking rates are also explored in the downstream phase. Through extensive evaluations, we demonstrate that the proposed contrastive pre-training, the random masking mechanism, and the ensemble architecture contribute to improving cough classification performance.

arXiv commentAccepted to ACM KDD 2021

References in corpus (10)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• AI4COVID-19: AI Enabled Preliminary Diagnosis for COVID-19 from Cough Samples via an App
• Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data
• Coswara -- A Database of Breathing, Cough, and Voice Sounds for COVID-19 Diagnosis
• The COUGHVID crowdsourcing dataset: A corpus for the study of large-scale cough analysis algorithms
• COVID-19 Cough Classification using Machine Learning and Global Smartphone Recordings
• Detecting COVID-19 from Breathing and Coughing Sounds using Deep Neural Networks
• Speech SIMCLR: Combining Contrastive and Reconstruction Objective for Self-supervised Speech Representation Learning
• TERMCast: Temporal Relation Modeling for Effective Urban Flow Forecasting

Cited by in corpus (2)

• COCOA: Cross Modality Contrastive Learning for Sensor Data
• WavRx: a Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model