A Map of Bandits for E-commerce
arXiv:2107.00680
Abstract
The rich body of Bandit literature not only offers a diverse toolbox of algorithms, but also makes it hard for a practitioner to find the right solution to solve the problem at hand. Typical textbooks on Bandits focus on designing and analyzing algorithms, and surveys on applications often present a list of individual applications. While these are valuable resources, there exists a gap in mapping applications to appropriate Bandit algorithms. In this paper, we aim to reduce this gap with a structured map of Bandits to help practitioners navigate to find relevant and practical Bandit algorithms. Instead of providing a comprehensive overview, we focus on a small number of key decision points related to reward, action, and features, which often affect how Bandit algorithms are chosen in practice.
arXiv commentAccepted by KDD Bandit and RL workshop: https://sites.google.com/view/marble-kdd/
References in corpus (17)
- A Contextual-Bandit Approach to Personalized News Article Recommendation
- Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design
- Thompson Sampling for Contextual Bandits with Linear Payoffs
- Unbiased Offline Evaluation of Contextual-bandit-based News Article Recommendation Algorithms
- Bandits with Knapsacks
- Contextual Bandit Algorithms with Supervised Learning Guarantees
- An Efficient Bandit Algorithm for Realtime Multivariate Optimization
- Learning from Logged Implicit Exploration Data
- A Survey on Practical Applications of Multi-Armed and Contextual Bandits
- Best-Arm Identification in Linear Bandits
- Neural Contextual Bandits with UCB-based Exploration
- Efficient Learning in Large-Scale Combinatorial Semi-Bandits
- Contextual Bandits with Continuous Actions: Smoothing, Zooming, and Adapting
- Linear Bandits with Stochastic Delayed Feedback
- A Bandit Approach to Posterior Dialog Orchestration Under a Budget
- Deep Neural Linear Bandits: Overcoming Catastrophic Forgetting through Likelihood Matching
- Markov Decision Process modeled with Bandits for Sequential Decision Making in Linear-flow