MIMIC-Extract: A Data Extraction, Preprocessing, and Representation Pipeline for MIMIC-III

Abstract

Robust machine learning relies on access to data that can be used with standardized frameworks in important tasks and the ability to develop models whose performance can be reasonably reproduced. In machine learning for healthcare, the community faces reproducibility challenges due to a lack of publicly accessible data and a lack of standardized data processing frameworks. We present MIMIC-Extract, an open-source pipeline for transforming raw electronic health record (EHR) data for critical care patients contained in the publicly-available MIMIC-III database into dataframes that are directly usable in common machine learning pipelines. MIMIC-Extract addresses three primary challenges in making complex health records data accessible to the broader machine learning community. First, it provides standardized data processing functions, including unit conversion, outlier detection, and aggregating semantically equivalent features, thus accounting for duplication and reducing missingness. Second, it preserves the time series nature of clinical data and can be easily integrated into clinically actionable prediction tasks in machine learning for health. Finally, it is highly extensible so that other researchers with related questions can easily use the same pipeline. We demonstrate the utility of this pipeline by showcasing several benchmark tasks and baseline results.

References in corpus (4)

• MiME: Multilevel Medical Embedding of Electronic Health Records for Predictive Healthcare
• Continuous State-Space Models for Optimal Sepsis Treatment - a Deep Reinforcement Learning Approach
• Feature Robustness in Non-stationary Health Records: Caveats to Deployable Model Performance in Common Clinical Machine Learning Tasks
• Reproducibility in Machine Learning for Health

Cited by in corpus (9)

• Benchmarking emergency department triage prediction models with machine learning and large public electronic health records
• Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Series
• GenHPF: General Healthcare Predictive Framework with Multi-task Multi-source Learning
• A Multidatabase ExTRaction PipEline (METRE) for Facile Cross Validation in Critical Care Research
• The Missing Indicator Method: From Low to High Dimensions
• Self-supervised learning-based general laboratory progress pretrained model for cardiovascular event detection
• Real-time Mortality Prediction Using MIMIC-IV ICU Data Via Boosted Nonparametric Hazards
• Ascle: A Python Natural Language Processing Toolkit for Medical Text Generation
• Scalable Unit Harmonization in Medical Informatics via Bayesian-Optimized Retrieval and Transformer-Based Re-ranking