A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series

Abstract

Sleep stage classification constitutes an important preliminary exam in the diagnosis of sleep disorders. It is traditionally performed by a sleep expert who assigns to each 30s of signal a sleep stage, based on the visual inspection of signals such as electroencephalograms (EEG), electrooculograms (EOG), electrocardiograms (ECG) and electromyograms (EMG). We introduce here the first deep learning approach for sleep stage classification that learns end-to-end without computing spectrograms or extracting hand-crafted features, that exploits all multivariate and multimodal Polysomnography (PSG) signals (EEG, EMG and EOG), and that can exploit the temporal context of each 30s window of data. For each modality the first layer learns linear spatial filters that exploit the array of sensors to increase the signal-to-noise ratio, and the last layer feeds the learnt representation to a softmax classifier. Our model is compared to alternative automatic approaches based on convolutional networks or decisions trees. Results obtained on 61 publicly available PSG records with up to 20 EEG channels demonstrate that our network architecture yields state-of-the-art performance. Our study reveals a number of insights on the spatio-temporal distribution of the signal of interest: a good trade-off for optimal classification performance measured with balanced accuracy is to use 6 EEG with 2 EOG (left and right) and 3 EMG chin channels. Also exploiting one minute of data before and after each data segment offers the strongest improvement when a limited number of channels is available. As sleep experts, our system exploits the multivariate and multimodal nature of PSG signals in order to deliver state-of-the-art classification performance with a small computational cost.

References in corpus (9)

• Adam: A Method for Stochastic Optimization
• XGBoost: A Scalable Tree Boosting System
• EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces
• Striving for Simplicity: The All Convolutional Net
• DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEG
• Mixed Neural Network Approach for Temporal Sleep Stage Classification
• Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks
• SLEEPNET: Automated Sleep Staging System via Deep Learning
• Deep Feature Learning for EEG Recordings

Cited by in corpus (45)

• SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging
• Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification
• SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantification
• XSleepNet: Multi-View Sequential Model for Automatic Sleep Staging
• Intra- and Inter-epoch Temporal Context Network (IITNet) Using Sub-epoch Features for Automatic Sleep Scoring on Raw Single-channel EEG
• Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning
• Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directions
• Deep Learning in EEG: Advance of the Last Ten-Year Critical Period
• MetaSleepLearner: A Pilot Study on Fast Adaptation of Bio-signals-Based Sleep Stage Classifier to New Individual Subject Using Meta-Learning
• Automatic sleep stage classification with deep residual networks in a mixed-cohort setting
• SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learning
• Do Not Sleep on Traditional Machine Learning: Simple and Interpretable Techniques Are Competitive to Deep Learning for Sleep Scoring
• U-Sleep's resilience to AASM guidelines
• MSED: a multi-modal sleep event detection model for clinical sleep analysis
• Biosignal Generation and Latent Variable Analysis with Recurrent Generative Adversarial Networks
• Multi-Scored Sleep Databases: How to Exploit the Multiple-Labels in Automated Sleep Scoring
• Automated scoring of pre-REM sleep in mice with deep learning
• LightSleepNet: Design of a Personalized Portable Sleep Staging System Based on Single-Channel EEG
• Cost-Sensitive Convolution based Neural Networks for Imbalanced Time-Series Classification
• Automatic detection of microsleep episodes with deep learning
• A Survey on Deep Learning-based Non-Invasive Brain Signals:Recent Advances and New Frontiers
• REST: Robust and Efficient Neural Networks for Sleep Monitoring in the Wild
• Multi-Channel Multi-Domain based Knowledge Distillation Algorithm for Sleep Staging with Single-Channel EEG
• SalientSleepNet: Multimodal Salient Wave Detection Network for Sleep Staging
• Multi-Task Learning for Arousal and Sleep Stage Detection Using Fully Convolutional Networks
• Towards a Flexible Deep Learning Method for Automatic Detection of Clinically Relevant Multi-Modal Events in the Polysomnogram
• Deep transfer learning for improving single-EEG arousal detection
• SLEEPER: interpretable Sleep staging via Prototypes from Expert Rules
• SERF: Interpretable Sleep Staging using Embeddings, Rules, and Features
• MSA-CNN: A Lightweight Multi-Scale CNN with Attention for Sleep Stage Classification
• Data augmentation for learning predictive models on EEG: a systematic comparison
• Evaluating the structure of cognitive tasks with transfer learning
• HetMAML: Task-Heterogeneous Model-Agnostic Meta-Learning for Few-Shot Learning Across Modalities
• DOSED: a deep learning approach to detect multiple sleep micro-events in EEG signal
• 2021 BEETL Competition: Advancing Transfer Learning for Subject Independence & Heterogenous EEG Data Sets
• Learning summary features of time series for likelihood free inference
• DeepSleepNet-Lite: A Simplified Automatic Sleep Stage Scoring Model with Uncertainty Estimates
• EEG-based Sleep Staging with Hybrid Attention
• NeuroSleepNet: An Explainable Multi-Head Attention-Based Framework With Spatial and Multi-Scale Independent Temporal Context Learning for Automatic Sleep Stage Scoring
• EEG Sleep Stage Classification with Continuous Wavelet Transform and Deep Learning
• A Structured Learning Approach with Neural Conditional Random Fields for Sleep Staging
• SummerTime: Variable-length Time SeriesSummarization with Applications to PhysicalActivity Analysis
• One-class Autoencoder Approach for Optimal Electrode Set-up Identification in Wearable EEG Event Monitoring
• Multi-View Spatial-Temporal Graph Convolutional Networks with Domain Generalization for Sleep Stage Classification
• Repairing Brain-Computer Interfaces with Fault-Based Data Acquisition