DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEG

Abstract

The present study proposes a deep learning model, named DeepSleepNet, for automatic sleep stage scoring based on raw single-channel EEG. Most of the existing methods rely on hand-engineered features which require prior knowledge of sleep analysis. Only a few of them encode the temporal information such as transition rules, which is important for identifying the next sleep stages, into the extracted features. In the proposed model, we utilize Convolutional Neural Networks to extract time-invariant features, and bidirectional-Long Short-Term Memory to learn transition rules among sleep stages automatically from EEG epochs. We implement a two-step training algorithm to train our model efficiently. We evaluated our model using different single-channel EEGs (F4-EOG(Left), Fpz-Cz and Pz-Oz) from two public sleep datasets, that have different properties (e.g., sampling rate) and scoring standards (AASM and R&K). The results showed that our model achieved similar overall accuracy and macro F1-score (MASS: 86.2%-81.7, Sleep-EDF: 82.0%-76.9) compared to the state-of-the-art methods (MASS: 85.9%-80.5, Sleep-EDF: 78.9%-73.7) on both datasets. This demonstrated that, without changing the model architecture and the training algorithm, our model could automatically learn features for sleep stage scoring from different raw single-channel EEGs from different datasets without utilizing any hand-engineered features.

arXiv commentThis article has been published in IEEE Transactions on Neural Systems and Rehabilitation Engineering

References in corpus (9)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• On the difficulty of training Recurrent Neural Networks
• Recurrent Neural Network Regularization
• Visualizing and Understanding Recurrent Networks
• Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition
• Mixed Neural Network Approach for Temporal Sleep Stage Classification
• Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks

Cited by in corpus (73)

• SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging
• A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series
• SleepEEGNet: Automated Sleep Stage Scoring with Sequence to Sequence Deep Learning Approach
• Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification
• SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantification
• XSleepNet: Multi-View Sequential Model for Automatic Sleep Staging
• Intra- and Inter-epoch Temporal Context Network (IITNet) Using Sub-epoch Features for Automatic Sleep Scoring on Raw Single-channel EEG
• CardioXNet: A Novel Lightweight Deep Learning Framework for Cardiovascular Disease Classification Using Heart Sound Recordings
• Self-supervised Contrastive Representation Learning for Semi-supervised Time-Series Classification
• Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning
• Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directions
• A Compact and Interpretable Convolutional Neural Network for Cross-Subject Driver Drowsiness Detection from Single-Channel EEG
• Deep Learning in EEG: Advance of the Last Ten-Year Critical Period
• MetaSleepLearner: A Pilot Study on Fast Adaptation of Bio-signals-Based Sleep Stage Classifier to New Individual Subject Using Meta-Learning
• Federated Self-Supervised Learning of Multi-Sensor Representations for Embedded Intelligence
• Automatic sleep stage classification with deep residual networks in a mixed-cohort setting
• COCOA: Cross Modality Contrastive Learning for Sensor Data
• A Review of Hidden Markov Models and Recurrent Neural Networks for Event Detection and Localization in Biomedical Signals
• SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learning
• Inter-database validation of a deep learning approach for automatic sleep scoring
• TensorLayer: A Versatile Library for Efficient Deep Learning Development
• Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformers
• Do Not Sleep on Traditional Machine Learning: Simple and Interpretable Techniques Are Competitive to Deep Learning for Sleep Scoring
• U-Sleep's resilience to AASM guidelines
• Convolutional Neural Networks for Sleep Stage Scoring on a Two-Channel EEG Signal
• Personalized Automatic Sleep Staging with Single-Night Data: a Pilot Study with KL-Divergence Regularization
• Label-efficient Time Series Representation Learning: A Review
• Subject-Independent Drowsiness Recognition from Single-Channel EEG with an Interpretable CNN-LSTM model
• MSED: a multi-modal sleep event detection model for clinical sleep analysis
• PrecTime: A Deep Learning Architecture for Precise Time Series Segmentation in Industrial Manufacturing Operations
• Pediatric Automatic Sleep Staging: A comparative study of state-of-the-art deep learning methods
• Multi-Scored Sleep Databases: How to Exploit the Multiple-Labels in Automated Sleep Scoring
• Automated scoring of pre-REM sleep in mice with deep learning
• LightSleepNet: Design of a Personalized Portable Sleep Staging System Based on Single-Channel EEG
• Addressing database variability in learning from medical data: an ensemble-based approach using convolutional neural networks and a case of study applied to automatic sleep scoring
• Automatic detection of microsleep episodes with deep learning
• A Systematic Literature Review of Spatio-Temporal Graph Neural Network Models for Time Series Forecasting and Classification
• A Survey on Deep Learning-based Non-Invasive Brain Signals:Recent Advances and New Frontiers
• Deep Efficient Continuous Manifold Learning for Time Series Modeling
• REST: Robust and Efficient Neural Networks for Sleep Monitoring in the Wild
• Multi-Channel Multi-Domain based Knowledge Distillation Algorithm for Sleep Staging with Single-Channel EEG
• Multi-center validation study of automated classification of pathological slowing in adult scalp electroencephalograms via frequency features
• A Wearable EEG System for Closed-Loop Neuromodulation of High-Frequency Sleep-Related Oscillations
• Multi-Task Learning for Arousal and Sleep Stage Detection Using Fully Convolutional Networks
• SalientSleepNet: Multimodal Salient Wave Detection Network for Sleep Staging
• Quantifying the Impact of Data Characteristics on the Transferability of Sleep Stage Scoring Models
• MSA-CNN: A Lightweight Multi-Scale CNN with Attention for Sleep Stage Classification
• Addressing Class Imbalance in Classification Problems of Noisy Signals by using Fourier Transform Surrogates
• SERF: Interpretable Sleep Staging using Embeddings, Rules, and Features
• Multi-Scale Neural network for EEG Representation Learning in BCI
• TRIER: Template-Guided Neural Networks for Robust and Interpretable Sleep Stage Identification from EEG Recordings
• A Convolutional Network for Sleep Stages Classification
• Real-Time Sleep Staging using Deep Learning on a Smartphone for a Wearable EEG
• CNNs, LSTMs, and Attention Networks for Pathology Detection in Medical Data
• Consciousness-ECG Transformer for Conscious State Estimation System with Real-Time Monitoring
• Diffuse to fuse EEG spectra -- intrinsic geometry of sleep dynamics for classification
• Deep learning approaches for neural decoding: from CNNs to LSTMs and spikes to fMRI
• Contrastive Learning for Sleep Staging based on Inter Subject Correlation
• EEG-based Sleep Staging with Hybrid Attention
• NeuroSleepNet: An Explainable Multi-Head Attention-Based Framework With Spatial and Multi-Scale Independent Temporal Context Learning for Automatic Sleep Stage Scoring
• MRNet: a Multi-scale Residual Network for EEG-based Sleep Staging
• DeepSleepNet-Lite: A Simplified Automatic Sleep Stage Scoring Model with Uncertainty Estimates
• AI Generalisation Gap In Comorbid Sleep Disorder Staging
• sDREAMER: Self-distilled Mixture-of-Modality-Experts Transformer for Automatic Sleep Staging
• Sleep Stage Classification Using Bidirectional LSTM in Wearable Multi-sensor Systems
• Sleep Staging Based on Multi Scale Dual Attention Network
• Exploring the robustness of permutation entropy analysis to differentiate between closed-eyes and open-eyes resting states
• A Structured Learning Approach with Neural Conditional Random Fields for Sleep Staging
• Self-supervised Contrastive Learning for EEG-based Sleep Staging
• Structure-Preserving Transformers for Sequences of SPD Matrices
• ConCAD: Contrastive Learning-based Cross Attention for Sleep Apnea Detection
• Multi-View Spatial-Temporal Graph Convolutional Networks with Domain Generalization for Sleep Stage Classification
• End-to-End Automatic Sleep Stage Classification Using Spectral-Temporal Sleep Features