Subject-Aware Contrastive Learning for Biosignals

Abstract

Datasets for biosignals, such as electroencephalogram (EEG) and electrocardiogram (ECG), often have noisy labels and have limited number of subjects (<100). To handle these challenges, we propose a self-supervised approach based on contrastive learning to model biosignals with a reduced reliance on labeled data and with fewer subjects. In this regime of limited labels and subjects, intersubject variability negatively impacts model performance. Thus, we introduce subject-aware learning through (1) a subject-specific contrastive loss, and (2) an adversarial training to promote subject-invariance during the self-supervised learning. We also develop a number of time-series data augmentation techniques to be used with the contrastive loss for biosignals. Our method is evaluated on publicly available datasets of two different biosignals with different tasks: EEG decoding and ECG anomaly detection. The embeddings learned using self-supervision yield competitive classification results compared to entirely supervised methods. We show that subject-invariance improves representation quality for these tasks, and observe that subject-specific loss increases performance when fine-tuning with supervised labels.

References in corpus (6)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• A Simple Framework for Contrastive Learning of Visual Representations
• Improved Regularization of Convolutional Neural Networks with Cutout
• Momentum Contrast for Unsupervised Visual Representation Learning
• Self-supervised Learning for ECG-based Emotion Recognition
• Controllable Invariance through Adversarial Feature Learning

Cited by in corpus (18)

• Self-Supervised Representation Learning: Introduction, Advances and Challenges
• Self-supervised Contrastive Representation Learning for Semi-supervised Time-Series Classification
• Self-supervised representation learning from 12-lead ECG data
• COCOA: Cross Modality Contrastive Learning for Sensor Data
• Time-Series Representation Learning via Temporal and Contextual Contrasting
• CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patients
• In-Distribution and Out-of-Distribution Self-supervised ECG Representation Learning for Arrhythmia Detection
• Channel Reflection: Knowledge-Driven Data Augmentation for EEG-Based Brain-Computer Interfaces
• Self-supervised EEG Representation Learning for Automatic Sleep Staging
• Mine Your Own vieW: Self-Supervised Learning Through Across-Sample Prediction
• Understand and Improve Contrastive Learning Methods for Visual Representation: A Review
• 3KG: Contrastive Learning of 12-Lead Electrocardiograms using Physiologically-Inspired Augmentations
• Domain Generalization for Session-Independent Brain-Computer Interface
• Wearable data from subjects playing Super Mario, sitting university exams, or performing physical exercise help detect acute mood episodes via self-supervised learning
• T-Rep: Representation Learning for Time Series using Time-Embeddings
• Transformer-based Self-supervised Multimodal Representation Learning for Wearable Emotion Recognition
• High Frequency EEG Artifact Detection with Uncertainty via Early Exit Paradigm
• PCPs: Patient Cardiac Prototypes