Classification of datasets with imputed missing values: does imputation quality matter?
arXiv:2206.08478 · doi:10.1038/s43856-023-00356-z
Abstract
Classifying samples in incomplete datasets is a common aim for machine learning practitioners, but is non-trivial. Missing data is found in most real-world datasets and these missing values are typically imputed using established methods, followed by classification of the now complete, imputed, samples. The focus of the machine learning researcher is then to optimise the downstream classification performance. In this study, we highlight that it is imperative to consider the quality of the imputation. We demonstrate how the commonly used measures for assessing quality are flawed and propose a new class of discrepancy scores which focus on how well the method recreates the overall distribution of the data. To conclude, we highlight the compromised interpretability of classifier models trained using poorly imputed data.
arXiv comment17 pages, 10 figures, 30 supplementary pages
References in corpus (4)
- MissForest - nonparametric missing value imputation for mixed-type data
- Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans
- Classification of datasets with imputed missing values: does imputation quality matter?
- An Empirical Comparison of Multiple Imputation Methods for Categorical Data