Data Heterogeneity Modeling for Trustworthy Machine Learning

Abstract

Data heterogeneity plays a pivotal role in determining the performance of machine learning (ML) systems. Traditional algorithms, which are typically designed to optimize average performance, often overlook the intrinsic diversity within datasets. This oversight can lead to a myriad of issues, including unreliable decision-making, inadequate generalization across different domains, unfair outcomes, and false scientific inferences. Hence, a nuanced approach to modeling data heterogeneity is essential for the development of dependable, data-driven systems. In this survey paper, we present a thorough exploration of heterogeneity-aware machine learning, a paradigm that systematically integrates considerations of data heterogeneity throughout the entire ML pipeline -- from data collection and model training to model evaluation and deployment. By applying this approach to a variety of critical fields, including healthcare, agriculture, finance, and recommendation systems, we demonstrate the substantial benefits and potential of heterogeneity-aware ML. These applications underscore how a deeper understanding of data diversity can enhance model robustness, fairness, and reliability and help model diagnosis and improvements. Moreover, we delve into future directions and provide research opportunities for the whole data mining community, aiming to promote the development of heterogeneity-aware ML.

Survey paper for tutorial "Data Heterogeneity Modeling for Trustworthy Machine Learning" in KDD'25

References in corpus (13)

• Domain Generalization: A Survey
• Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans
• Robust Wasserstein Profile Inference and Applications to Machine Learning
• Identifying Mislabeled Data using the Area Under the Margin Ranking
• Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization
• Turning the Tables: Biased, Imbalanced, Dynamic Tabular Datasets for ML Evaluation
• Where Does My Model Underperform? A Human Evaluation of Slice Discovery Algorithms
• On Tilted Losses in Machine Learning: Theory and Applications
• Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular data
• Evaluating Robustness to Dataset Shift via Parametric Robustness Sets
• Environment Diversification with Multi-head Neural Network for Invariant Learning
• TRIAGE: Characterizing and auditing training data for improved regression
• A hierarchical decomposition for explaining ML performance discrepancies