A Survey on Programmatic Weak Supervision
arXiv:2202.05433
Abstract
Labeling training data has become one of the major roadblocks to using machine learning. Among various weak supervision paradigms, programmatic weak supervision (PWS) has achieved remarkable success in easing the manual labeling bottleneck by programmatically synthesizing training labels from multiple potentially noisy supervision sources. This paper presents a comprehensive survey of recent advances in PWS. In particular, we give a brief introduction of the PWS learning paradigm, and review representative approaches for each component within PWS's learning workflow. In addition, we discuss complementary learning paradigms for tackling limited labeled data scenarios and how these related approaches can be used in conjunction with PWS. Finally, we identify several critical challenges that remain under-explored in the area to hopefully inspire future research directions in the field.
arXiv comment8 pages
Cited by in corpus (7)
- Unsupervised classification to improve the quality of a bird song recording dataset
- CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation
- VideoPro: A Visual Analytics Approach for Interactive Video Programming
- LabelAId: Just-in-time AI Interventions for Improving Human Labeling Quality and Domain Knowledge in Crowdsourcing Systems
- Local Boosting for Weakly-Supervised Learning
- Neural-Hidden-CRF: A Robust Weakly-Supervised Sequence Labeler
- Model-Driven Rapid Prototyping for Control Algorithms with the GIPS Framework (System Description)