5 papers · 1 filter
Deep Active Learning in the Open World
Tian Xie, Jifan Zhang, Haoyue Bai +1
Machine learning models deployed in open-world scenarios often encounter unfamiliar conditions and perform poorly in unanticipated situations. As AI systems advance and find applic…
AHA: Human-Assisted Out-of-Distribution Generalization and Detection
Haoyue Bai, Jifan Zhang, Robert Nowak
Modern machine learning models deployed often encounter distribution shifts in real-world applications, manifesting as covariate or semantic out-of-distribution (OOD) shifts. These…
Improved Algorithm for Deep Active Learning under Imbalance via Optimal Separation
Shyam Nuggehalli, Jifan Zhang, Lalit Jain +1
Class imbalance severely impacts machine learning performance on minority classes in real-world applications. While various solutions exist, active learning offers a fundamental fi…
LabelBench: A Comprehensive Framework for Benchmarking Adaptive Label-Efficient Learning
Jifan Zhang, Yifang Chen, Gregory Canal +8
Labeled data are critical to modern machine learning applications, but obtaining labels can be expensive. To mitigate this cost, machine learning methods, such as transfer learning…
Practical, Provably-Correct Interactive Learning in the Realizable Setting: The Power of True Believers
Julian Katz-Samuels, Blake Mason, Kevin Jamieson +1
We consider interactive learning in the realizable setting and develop a general framework to handle problems ranging from best arm identification to active classification. We begi…