Self-supervised EEG Representation Learning for Automatic Sleep Staging
arXiv:2110.15278
Abstract
Background: Deep learning models have shown great success in automating tasks in sleep medicine by learning from carefully annotated Electroencephalogram (EEG) data. However, effectively utilizing a large amount of raw EEG remains a challenge. Objective: In this paper, we aim to learn robust vector representations from massive unlabeled EEG signals, such that the learned vectorized features (1) are expressive enough to replace the raw signals in the sleep staging task; and (2) provide better predictive performance than supervised models in scenarios of fewer labels and noisy samples. Methods: We propose a self-supervised model, named Contrast with the World Representation (ContraWR), for EEG signal representation learning, which uses global statistics from the dataset to distinguish signals associated with different sleep stages. The ContraWR model is evaluated on three real-world EEG datasets that include both at-home and in-lab EEG recording settings. Results: ContraWR outperforms 4 recent self-supervised learning methods on the sleep staging task across 3 large EEG datasets. ContraWR also beats supervised learning when fewer training labels are available (e.g., 4% accuracy improvement when less than 2% data is labeled). Moreover, the model provides informative representative feature structures in 2D projection. Conclusions: We show that ContraWR is robust to noise and can provide high-quality EEG representations for downstream prediction tasks. The proposed model can be generalized to other unsupervised physiological signal learning tasks. Future directions include exploring task-specific data augmentations and combining self-supervised with supervised methods, building upon the initial success of self-supervised learning in this paper.
arXiv commentPreprocessing and Code in Github: https://github.com/ycq091044/ContraWR
References in corpus (12)
- Adam: A Method for Stochastic Optimization
- UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
- A Simple Framework for Contrastive Learning of Visual Representations
- Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
- Learning deep representations by mutual information estimation and maximization
- Adversarial Feature Learning
- Exploring Simple Siamese Representation Learning
- On Mutual Information Maximization for Representation Learning
- SLEEPNET: Automated Sleep Staging System via Deep Learning
- Subject-Aware Contrastive Learning for Biosignals
- Contrastive Learning with Hard Negative Samples
- SLEEPER: interpretable Sleep staging via Prototypes from Expert Rules