Deep learning for temporal data representation in electronic health records: A systematic review of challenges and methodologies

Abstract

Objective: Temporal electronic health records (EHRs) can be a wealth of information for secondary uses, such as clinical events prediction or chronic disease management. However, challenges exist for temporal data representation. We therefore sought to identify these challenges and evaluate novel methodologies for addressing them through a systematic examination of deep learning solutions. Methods: We searched five databases (PubMed, EMBASE, the Institute of Electrical and Electronics Engineers [IEEE] Xplore Digital Library, the Association for Computing Machinery [ACM] digital library, and Web of Science) complemented with hand-searching in several prestigious computer science conference proceedings. We sought articles that reported deep learning methodologies on temporal data representation in structured EHR data from January 1, 2010, to August 30, 2020. We summarized and analyzed the selected articles from three perspectives: nature of time series, methodology, and model implementation. Results: We included 98 articles related to temporal data representation using deep learning. Four major challenges were identified, including data irregularity, data heterogeneity, data sparsity, and model opacity. We then studied how deep learning techniques were applied to address these challenges. Finally, we discuss some open challenges arising from deep learning. Conclusion: Temporal EHR data present several major challenges for clinical prediction modeling and data utilization. To some extent, current deep learning solutions can address these challenges. Future studies can consider designing comprehensive and integrated solutions. Moreover, researchers should incorporate additional clinical domain knowledge into study designs and enhance the interpretability of the model to facilitate its implementation in clinical practice.

References in corpus (20)

• Distributed Representations of Words and Phrases and their Compositionality
• Scalable and accurate deep learning for electronic health records
• Deep EHR: A Survey of Recent Advances in Deep Learning Techniques for Electronic Health Record (EHR) Analysis
• Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directions
• Multitask learning and benchmarking with clinical time series data
• Supersparse Linear Integer Models for Optimized Medical Scoring Systems
• RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical Records
• Multi-source Transfer Learning with Convolutional Neural Networks for Lung Pattern Analysis
• Deep Representation Learning of Patient Data from Electronic Health Records (EHR): A Systematic Review
• Deep Representation Learning of Electronic Health Records to Unlock Patient Stratification at Scale
• Patient2Vec: A Personalized Interpretable Deep Representation of the Longitudinal Electronic Health Record
• MiME: Multilevel Medical Embedding of Electronic Health Records for Predictive Healthcare
• StageNet: Stage-Aware Neural Networks for Health Risk Prediction
• CarePre: An Intelligent Clinical Decision Assistance System
• Learning Optimized Risk Scores
• Adversarial Multi-Source Transfer Learning in Healthcare: Application to Glucose Prediction for Diabetic People
• Learning Tasks for Multitask Learning: Heterogenous Patient Populations in the ICU
• SepsisLab: Early Sepsis Prediction with Uncertainty Quantification and Active Sensing
• Temporal Self-Attention Network for Medical Concept Embedding
• AutoScore-Imbalance: An interpretable machine learning tool for development of clinical scores with rare events data

Cited by in corpus (3)

• Benchmarking emergency department triage prediction models with machine learning and large public electronic health records
• A scoping review on multimodal deep learning in biomedical images and texts
• Advancing Precision Oncology Through Modeling of Longitudinal and Multimodal Data