Learning under Concept Drift: A Review

Abstract

Concept drift describes unforeseeable changes in the underlying distribution of streaming data over time. Concept drift research involves the development of methodologies and techniques for drift detection, understanding and adaptation. Data analysis has revealed that machine learning in a concept drift environment will result in poor learning results if the drift is not addressed. To help researchers identify which research topics are significant and how to apply related techniques in data analysis tasks, it is necessary that a high quality, instructive review of current research developments and trends in the concept drift field is conducted. In addition, due to the rapid development of concept drift in recent years, the methodologies of learning under concept drift have become noticeably systematic, unveiling a framework which has not been mentioned in literature. This paper reviews over 130 high quality publications in concept drift related research areas, analyzes up-to-date developments in methodologies and techniques, and establishes a framework of learning under concept drift including three main components: concept drift detection, concept drift understanding, and concept drift adaptation. This paper lists and discusses 10 popular synthetic datasets and 14 publicly available benchmark datasets used for evaluating the performance of learning algorithms aiming at handling concept drift. Also, concept drift related research directions are covered and discussed. By providing state-of-the-art knowledge, this survey will directly support researchers in their understanding of research developments in the field of learning under concept drift.

References in corpus (2)

• Exponentially Weighted Moving Average Charts for Detecting Concept Drift
• Request-and-Reverify: Hierarchical Hypothesis Testing for Concept Drift Detection with Expensive Labels

Cited by in corpus (57)

• Towards Personalized Federated Learning
• Class-Incremental Learning: A Survey
• A Lightweight Concept Drift Detection and Adaptation Framework for IoT Data Streams
• Meaningful human control: actionable properties for AI system development
• Active learning for data streams: a survey
• Concept Drift Detection via Equal Intensity k-means Space Partitioning
• IoT Data Analytics in Dynamic Environments: From An Automated Machine Learning Perspective
• Random Partitioning Forest for Point-Wise and Collective Anomaly Detection -- Application to Intrusion Detection
• Concept drift detection and adaptation for federated and continual learning
• Diverse Instances-Weighting Ensemble based on Region Drift Disagreement for Concept Drift Adaptation
• PWPAE: An Ensemble Framework for Concept Drift Adaptation in IoT Data Streams
• An Adaptive Deep Learning Framework for Day-ahead Forecasting of Photovoltaic Power Generation
• A Multi-Stage Automated Online Network Data Stream Analytics Framework for IIoT Systems
• Patchwork Learning: A Paradigm Towards Integrative Analysis across Diverse Biomedical Data Sources
• Diagnosing Concept Drift with Visual Analytics
• Unsupervised Concept Drift Detection from Deep Learning Representations in Real-time
• Machine Learning for QoS Prediction in Vehicular Communication: Challenges and Solution Approaches
• Enabling AutoML for Zero-Touch Network Security: Use-Case Driven Analysis
• Towards Zero Touch Networks: Cross-Layer Automated Security Solutions for 6G Wireless Networks
• Multi-label Classification via Adaptive Resonance Theory-based Clustering
• Situation-based memory in spiking neuron-astrocyte network
• Fraud Analytics: A Decade of Research -- Organizing Challenges and Solutions in the Field
• Statistical process monitoring of artificial neural networks
• Adaptive Resonance Theory-based Topological Clustering with a Divisive Hierarchical Structure Capable of Continual Learning
• Joint PMD Tracking and Nonlinearity Compensation with Deep Neural Networks
• Moderating New Waves of Online Hate with Chain-of-Thought Reasoning in Large Language Models
• iPDP: On Partial Dependence Plots in Dynamic Modeling Scenarios
• Addressing Gap between Training Data and Deployed Environment by On-Device Learning
• A Hybrid Active-Passive Approach to Imbalanced Nonstationary Data Stream Classification
• Unsupervised Detection of Behavioural Drifts with Dynamic Clustering and Trajectory Analysis
• In Search of netUnicorn: A Data-Collection Platform to Develop Generalizable ML Models for Network Security Problems
• Nonparametric and Online Change Detection in Multivariate Datastreams using QuantTree
• Data science on industrial data -- Today's challenges in brown field applications
• Dynamic Model Tree for Interpretable Data Stream Learning
• Class Distribution Monitoring for Concept Drift Detection
• Modyn: Data-Centric Machine Learning Pipeline Orchestration
• OPTWIN: Drift identification with optimal sub-windows
• MARLINE: Multi-Source Mapping Transfer Learning for Non-Stationary Environments
• Sustaining model performance for covid-19 detection from dynamic audio data: Development and evaluation of a comprehensive drift-adaptive framework
• On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboards
• Incremental Learning with Concept Drift Detection and Prototype-based Embeddings for Graph Stream Classification
• A Time-aware tensor decomposition for tracking evolving patterns
• Online detection and infographic explanation of spam reviews with data drift adaptation
• Learning Unbiased Cluster Descriptors for Interpretable Imbalanced Concept Drift Detection
• Distance Functions and Normalization Under Stream Scenarios
• Learning from Discriminatory Training Data
• DSAP: Analyzing Bias Through Demographic Comparison of Datasets
• How to Sustainably Monitor ML-Enabled Systems? Accuracy and Energy Efficiency Tradeoffs in Concept Drift Detection
• Continuous Management of Machine Learning-Based Application Behavior
• Advanced Machine Learning Framework for Efficient Plant Disease Prediction
• A Study on Multi-Class Online Fuzzy Classifiers for Dynamic Environments
• MAcPNN: Mutual Assisted Learning on Data Streams with Temporal Dependence
• Don't Look Back in Anger: MAGIC Net for Streaming Continual Learning with Temporal Dependence
• A Method for Discovering Novel Classes in Tabular Data
• Backward Compatibility in Tree-Based Explanations and Enhanced CART Algorithm
• AI of the People, by the People, for the People: A Social Choice Approach to Collective Control of Artificial Intelligence
• "A 6 or a 9?": Ensemble Learning Through the Multiplicity of Performant Models and Explanations