Opportunistic Learning: Budgeted Cost-Sensitive Learning from Data Streams

Abstract

In many real-world learning scenarios, features are only acquirable at a cost constrained under a budget. In this paper, we propose a novel approach for cost-sensitive feature acquisition at the prediction-time. The suggested method acquires features incrementally based on a context-aware feature-value function. We formulate the problem in the reinforcement learning paradigm, and introduce a reward function based on the utility of each feature. Specifically, MC dropout sampling is used to measure expected variations of the model uncertainty which is used as a feature-value function. Furthermore, we suggest sharing representations between the class predictor and value function estimator networks. The suggested approach is completely online and is readily applicable to stream learning setups. The solution is evaluated on three different datasets including the well-known MNIST dataset as a benchmark as well as two cost-sensitive datasets: Yahoo Learning to Rank and a dataset in the medical domain for diabetes classification. According to the results, the proposed method is able to efficiently acquire features and make accurate predictions.

https://openreview.net/forum?id=S1eOHo09KX

References in corpus (17)

• Adam: A Method for Stochastic Optimization
• Least Angle Regression
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Rejoinder to "Least angle regression" by Efron et al
• Playing Atari with Deep Reinforcement Learning
• On Calibration of Modern Neural Networks
• Adaptive Classification for Prediction Under a Budget
• Dynamic Feature Acquisition Using Denoising Autoencoders
• Active Information Acquisition
• Why Pay More When You Can Pay Less: A Joint Learning Framework for Active Feature Acquisition and Classification

Cited by in corpus (4)

• Classification with Costly Features as a Sequential Decision-Making Problem
• Target-Focused Feature Selection Using a Bayesian Approach
• Feedback-Based Dynamic Feature Selection for Constrained Continuous Data Acquisition
• Classification with Costly Features in Hierarchical Deep Sets