A Survey of Human-in-the-loop for Machine Learning

Abstract

Human-in-the-loop aims to train an accurate prediction model with minimum cost by integrating human knowledge and experience. Humans can provide training data for machine learning applications and directly accomplish tasks that are hard for computers in the pipeline with the help of machine-based approaches. In this paper, we survey existing works on human-in-the-loop from a data perspective and classify them into three categories with a progressive relationship: (1) the work of improving model performance from data processing, (2) the work of improving model performance through interventional model training, and (3) the design of the system independent human-in-the-loop. Using the above categorization, we summarize major approaches in the field; along with their technical strengths/ weaknesses, we have simple classification and discussion in natural language processing, computer vision, and others. Besides, we provide some open challenges and opportunities. This survey intends to provide a high-level summarization for human-in-the-loop and motivates interested readers to consider approaches for designing effective human-in-the-loop solutions.

References in corpus (15)

• Domain Generalization: A Survey
• Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
• EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning
• A Survey: Deep Learning for Hyperspectral Image Classification with Few Labeled Samples
• Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesis
• WhittleSearch: Interactive Image Search with Relative Attribute Feedback
• Dialogue Learning With Human-In-The-Loop
• Video Object Segmentation and Tracking: A Survey
• Semi-Automatic Data Annotation guided by Feature Space Projection
• Learning from Few Samples: A Survey
• Interactive Video Object Segmentation in the Wild
• Image Aesthetics Assessment Using Composite Features from off-the-Shelf Deep Models
• Transitioning to human interaction with AI systems: New challenges and opportunities for HCI professionals to enable human-centered AI
• Rise of the HaCRS: Augmenting Autonomous Cyber Reasoning Systems with Human Assistance
• When and Why does a Model Fail? A Human-in-the-loop Error Detection Framework for Sentiment Analysis

Cited by in corpus (19)

• From Explainable to Interpretable Deep Learning for Natural Language Processing in Healthcare: How Far from Reality?
• Expert enhanced dynamic time warping based anomaly detection
• AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Tools
• Seeing the random forest through the decision trees. Supporting learning health systems from histopathology with machine learning models: Challenges and opportunities
• Evaluating Large Language Models as Virtual Annotators for Time-series Physical Sensing Data
• Observe, Ask, Intervene: Designing AI Agents for More Inclusive Meetings
• A Matter of Annotation: An Empirical Study on In Situ and Self-Recall Activity Annotations from Wearable Sensors
• A Workflow Model for Holistic Data Management and Semantic Interoperability in Quantitative Archival Research
• DEUCE: Dual-diversity Enhancement and Uncertainty-awareness for Cold-start Active Learning
• Modyn: Data-Centric Machine Learning Pipeline Orchestration
• Peek into the `White-Box': A Field Study on Bystander Engagement with Urban Robot Uncertainty
• Interactive Double Deep Q-network: Integrating Human Interventions and Evaluative Predictions in Reinforcement Learning of Autonomous Driving
• Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Control
• Human-in-the-Loop Annotation for Image-Based Engagement Estimation: Assessing the Impact of Model Reliability on Annotation Accuracy
• From Privacy to Trust in the Agentic Era: A Taxonomy of Challenges in Trustworthy Federated Learning Through the Lens of Trust Report 2.0
• Continual Learning at the Edge: An Agnostic IIoT Architecture
• Research evolution of metal organic frameworks: A scientometric approach with human-in-the-loop
• ViMMRC 2.0 -- Enhancing Machine Reading Comprehension on Vietnamese Literature Text
• Online Behavior Modification for Expressive User Control of RL-Trained Robots