Natural Language Generation for Electronic Health Records

Abstract

A variety of methods existing for generating synthetic electronic health records (EHRs), but they are not capable of generating unstructured text, like emergency department (ED) chief complaints, history of present illness or progress notes. Here, we use the encoder-decoder model, a deep learning algorithm that features in many contemporary machine translation systems, to generate synthetic chief complaints from discrete variables in EHRs, like age group, gender, and discharge diagnosis. After being trained end-to-end on authentic records, the model can generate realistic chief complaint text that preserves much of the epidemiological information in the original data. As a side effect of the model's optimization goal, these synthetic chief complaints are also free of relatively uncommon abbreviation and misspellings, and they include none of the personally-identifiable information (PII) that was in the training data, suggesting it may be used to support the de-identification of text in EHRs. When combined with algorithms like generative adversarial networks (GANs), our model could be used to generate fully-synthetic EHRs, facilitating data sharing between healthcare providers and researchers and improving our ability to develop machine learning methods tailored to the information in healthcare data.

References in corpus (9)

• Adam: A Method for Stochastic Optimization
• Scikit-learn: Machine Learning in Python
• Distributed Representations of Words and Phrases and their Compositionality
• The NumPy array: a structure for efficient numerical computation
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challenge
• Generating Multi-label Discrete Patient Records using Generative Adversarial Networks
• Show and Tell: A Neural Image Caption Generator

Cited by in corpus (11)

• ChatGPT for Shaping the Future of Dentistry: The Potential of Multi-Modal Large Language Model
• Generative AI for Synthetic Data Across Multiple Medical Modalities: A Systematic Review of Recent Developments and Challenges
• Synthesize High-dimensional Longitudinal Electronic Health Records via Hierarchical Autoregressive Language Model
• DeepHealth: Review and challenges of artificial intelligence in health informatics
• Towards Clinical Encounter Summarization: Learning to Compose Discharge Summaries from Prior Notes
• Exploring Optimal Granularity for Extractive Summarization of Unstructured Health Records: Analysis of the Largest Multi-Institutional Archive of Health Records in Japan
• A Biomedical Entity Extraction Pipeline for Oncology Health Records in Portuguese
• Logic2Text: High-Fidelity Natural Language Generation from Logical Forms
• Is In-hospital Meta-information Useful for Abstractive Discharge Summary Generation?
• LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training
• Is artificial data useful for biomedical Natural Language Processing algorithms?