Representation Learning for Electronic Health Records
arXiv:1909.09248
Abstract
Information in electronic health records (EHR), such as clinical narratives, examination reports, lab measurements, demographics, and other patient encounter entries, can be transformed into appropriate data representations that can be used for downstream clinical machine learning tasks using representation learning. Learning better representations is critical to improve the performance of downstream tasks. Due to the advances in machine learning, we now can learn better and meaningful representations from EHR through disentangling the underlying factors inside data and distilling large amounts of information and knowledge from heterogeneous EHR sources. In this chapter, we first introduce the background of learning representations and reasons why we need good EHR representations in machine learning for medicine and healthcare in Section 1. Next, we explain the commonly-used machine learning and evaluation methods for representation learning using a deep learning approach in Section 2. Following that, we review recent related studies of learning patient state representation from EHR for clinical machine learning tasks in Section 3. Finally, in Section 4 we discuss more techniques, studies, and challenges for learning natural language representations when free texts, such as clinical notes, examination reports, or biomedical literature are used. We also discuss challenges and opportunities in these rapidly growing research fields.
References in corpus (38)
- Efficient Estimation of Word Representations in Vector Space
- Distributed Representations of Words and Phrases and their Compositionality
- A Survey on Deep Learning in Medical Image Analysis
- Sequence to Sequence Learning with Neural Networks
- Semi-Supervised Classification with Graph Convolutional Networks
- A Unified Approach to Interpreting Model Predictions
- UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
- BioBERT: a pre-trained biomedical language representation model for biomedical text mining
- Distributed Representations of Sentences and Documents
- Predicting Cardiovascular Risk Factors from Retinal Fundus Photographs using Deep Learning
- On the Properties of Neural Machine Translation: Encoder-Decoder Approaches
- ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission
- Detecting Cancer Metastases on Gigapixel Pathology Images
- Learning to Diagnose with LSTM Recurrent Neural Networks
- Development and Validation of a Deep Learning Algorithm for Improving Gleason Scoring of Prostate Cancer
- Microscope 2.0: An Augmented Reality Microscope with Real-time Artificial Intelligence Integration
- "Why Should I Trust You?": Explaining the Predictions of Any Classifier
- Enhancing Clinical Concept Extraction with Contextual Embeddings
- A Review of Challenges and Opportunities in Machine Learning for Health
- Learning Representations for Counterfactual Inference
- MiME: Multilevel Medical Embedding of Electronic Health Records for Predictive Healthcare
- Clinically Accurate Chest X-Ray Report Generation
- Continuous State-Space Models for Optimal Sepsis Treatment - a Deep Reinforcement Learning Approach
- DeepCare: A Deep Dynamic Memory Model for Predictive Medicine
- Unsupervised Cross-Modal Alignment of Speech and Text Embedding Spaces
- Learning Deep Representations of Medical Images using Siamese CNNs with Application to Content-Based Image Retrieval
- Representation and Reinforcement Learning for Personalized Glycemic Control in Septic Patients
- A Deep Learning Architecture for De-identification of Patient Notes: Implementation and Evaluation
- Audio Word2Vec: Unsupervised Learning of Audio Segment Representations using Sequence-to-sequence Autoencoder
- A Comparison of Word Embeddings for the Biomedical Natural Language Processing
- Unsupervised Multimodal Representation Learning across Medical Images and Reports
- CliNER 2.0: Accessible and Accurate Clinical Concept Extraction
- Multimodal Multitask Representation Learning for Pathology Biobank Metadata Prediction
- Effective Representations of Clinical Notes
- Predicting Blood Pressure Response to Fluid Bolus Therapy Using Attention-Based Neural Networks for Clinical Interpretability
- AWE-CM Vectors: Augmenting Word Embeddings with a Clinical Metathesaurus
- Mapping Unparalleled Clinical Professional and Consumer Languages with Embedding Alignment
- Learning Contextual Hierarchical Structure of Medical Concepts with Poincairé Embeddings to Clarify Phenotypes