Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning

Abstract

Background: Despite recent significant progress in the development of automatic sleep staging methods, building a good model still remains a big challenge for sleep studies with a small cohort due to the data-variability and data-inefficiency issues. This work presents a deep transfer learning approach to overcome these issues and enable transferring knowledge from a large dataset to a small cohort for automatic sleep staging. Methods: We start from a generic end-to-end deep learning framework for sequence-to-sequence sleep staging and derive two networks as the means for transfer learning. The networks are first trained in the source domain (i.e. the large database). The pretrained networks are then finetuned in the target domain (i.e. the small cohort) to complete knowledge transfer. We employ the Montreal Archive of Sleep Studies (MASS) database consisting of 200 subjects as the source domain and study deep transfer learning on three different target domains: the Sleep Cassette subset and the Sleep Telemetry subset of the Sleep-EDF Expanded database, and the Surrey-cEEGrid database. The target domains are purposely adopted to cover different degrees of data mismatch to the source domains. Results: Our experimental results show significant performance improvement on automatic sleep staging on the target domains achieved with the proposed deep transfer learning approach. Conclusions: These results suggest the efficacy of the proposed approach in addressing the above-mentioned data-variability and data-inefficiency issues. Significance: As a consequence, it would enable one to improve the quality of automatic sleep staging models when the amount of data is relatively small. The source code and the pretrained models are available at http://github.com/pquochuy/sleep_transfer_learning.

This article has been published in IEEE Transactions on Biomedical Engineering

References in corpus (16)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEG
• SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging
• A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series
• Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification
• Neural network an1alysis of sleep stages enables efficient diagnosis of narcolepsy
• Mixed Neural Network Approach for Temporal Sleep Stage Classification
• Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks
• Intra- and Inter-epoch Temporal Context Network (IITNet) Using Sub-epoch Features for Automatic Sleep Scoring on Raw Single-channel EEG
• SLEEPNET: Automated Sleep Staging System via Deep Learning
• U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Staging
• Personalized Automatic Sleep Staging with Single-Night Data: a Pilot Study with KL-Divergence Regularization
• Personalizing deep learning models for automatic sleep staging
• Deep residual networks for automatic sleep stage classification of raw polysomnographic waveforms

Cited by in corpus (19)

• EXPANSE: A Deep Continual / Progressive Learning System for Deep Transfer Learning
• A Review of Deep Transfer Learning and Recent Advancements
• SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantification
• XSleepNet: Multi-View Sequential Model for Automatic Sleep Staging
• Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directions
• MetaSleepLearner: A Pilot Study on Fast Adaptation of Bio-signals-Based Sleep Stage Classifier to New Individual Subject Using Meta-Learning
• Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformers
• Do Not Sleep on Traditional Machine Learning: Simple and Interpretable Techniques Are Competitive to Deep Learning for Sleep Scoring
• U-Sleep's resilience to AASM guidelines
• PrecTime: A Deep Learning Architecture for Precise Time Series Segmentation in Industrial Manufacturing Operations
• Pediatric Automatic Sleep Staging: A comparative study of state-of-the-art deep learning methods
• LightSleepNet: Design of a Personalized Portable Sleep Staging System Based on Single-Channel EEG
• Multi-Channel Multi-Domain based Knowledge Distillation Algorithm for Sleep Staging with Single-Channel EEG
• Quantifying the Impact of Data Characteristics on the Transferability of Sleep Stage Scoring Models
• aSAGA: Automatic Sleep Analysis with Gray Areas
• Light-weight sleep monitoring: electrode distance matters more than placement for automatic scoring
• Sleep Staging Based on Multi Scale Dual Attention Network
• PromptTSS: A Prompting-Based Approach for Interactive Multi-Granularity Time Series Segmentation
• DeepSleepNet-Lite: A Simplified Automatic Sleep Stage Scoring Model with Uncertainty Estimates