Active learning for data streams: a survey
arXiv:2302.08893 · doi:10.1007/s10994-023-06454-2
Abstract
Online active learning is a paradigm in machine learning that aims to select the most informative data points to label from a data stream. The problem of minimizing the cost associated with collecting labeled observations has gained a lot of attention in recent years, particularly in real-world applications where data is only available in an unlabeled form. Annotating each observation can be time-consuming and costly, making it difficult to obtain large amounts of labeled data. To overcome this issue, many active learning strategies have been proposed in the last decades, aiming to select the most informative observations for labeling in order to improve the performance of machine learning models. These approaches can be broadly divided into two categories: static pool-based and stream-based active learning. Pool-based active learning involves selecting a subset of observations from a closed pool of unlabeled data, and it has been the focus of many surveys and literature reviews. However, the growing availability of data streams has led to an increase in the number of approaches that focus on online active learning, which involves continuously selecting and labeling observations as they arrive in a stream. This work aims to provide an overview of the most recently proposed approaches for selecting the most informative observations from data streams in real time. We review the various techniques that have been proposed and discuss their strengths and limitations, as well as the challenges and opportunities that exist in this area of research.
arXiv commentPublished in Machine Learning (2023)
References in corpus (23)
- Estimating Mutual Information
- Learning under Concept Drift: A Review
- Active Learning for Convolutional Neural Networks: A Core-Set Approach
- Evaluating time series forecasting models: An empirical study on performance estimation methods
- Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Bounds
- A survey on learning from imbalanced data streams: taxonomy, challenges, empirical study, and reproducible experimental framework
- A Bayesian Data Augmentation Approach for Learning Deep Models
- Streaming Active Learning Strategies for Real-Life Credit Card Fraud Detection: Assessment and Visualization
- Mondrian Forests: Efficient Online Random Forests
- Double Ramp Loss Based Reject Option Classifier
- Fast active learning for pure exploration in reinforcement learning
- Stream-based active learning with linear models
- Robust online active learning
- Detecting Concept Drift With Neural Network Model Uncertainty
- Bayesian Active Learning with Fully Bayesian Gaussian Processes
- Sequential Experimental Design for Transductive Linear Bandits
- Detecting and Adapting to Irregular Distribution Shifts in Bayesian Online Learning
- Modelling the COVID-19 virus evolution with Incremental Machine Learning
- Examining and Combating Spurious Features under Distribution Shift
- Annotation Cost Reduction of Stream-based Active Learning by Automated Weak Labeling using a Robot Arm
- Active Learning for Accurate Estimation of Linear Models
- Combining Thermodynamics-based Model of the Centrifugal Compressors and Active Machine Learning for Enhanced Industrial Design Optimization
- Selective Sampling for Online Best-arm Identification