On Multi-Armed Bandit Designs for Dose-Finding Clinical Trials
arXiv:1903.07082
Abstract
We study the problem of finding the optimal dosage in early stage clinical trials through the multi-armed bandit lens. We advocate the use of the Thompson Sampling principle, a flexible algorithm that can accommodate different types of monotonicity assumptions on the toxicity and efficacy of the doses. For the simplest version of Thompson Sampling, based on a uniform prior distribution for each dose, we provide finite-time upper bounds on the number of sub-optimal dose selections, which is unprecedented for dose-finding algorithms. Through a large simulation study, we then show that variants of Thompson Sampling based on more sophisticated prior distributions outperform state-of-the-art dose identification algorithms in different types of dose-finding studies that occur in phase I or phase I/II trials.
References in corpus (9)
- A Contextual-Bandit Approach to Personalized News Article Recommendation
- A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
- Analysis of Thompson Sampling for the multi-armed bandit problem
- Thompson Sampling for Contextual Bandits with Linear Payoffs
- Further Optimal Regret Bounds for Thompson Sampling
- An optimal algorithm for the Thresholding Bandit Problem
- Tight (Lower) Bounds for the Fixed Budget Best Arm Identification Bandit Problem
- The Finite-Horizon Two-Armed Bandit Problem with Binary Responses: A Multidisciplinary Survey of the History, State of the Art, and Myths
- Thresholding Bandit for Dose-ranging: The Impact of Monotonicity
Cited by in corpus (6)
- Efficient Online Bayesian Inference for Neural Bandits
- The Survival Bandit Problem
- Some performance considerations when using multi-armed bandit algorithms in the presence of missing data
- Debiasing Samples from Online Learning Using Bootstrap
- Multi-armed Bandit Requiring Monotone Arm Sequences
- ESCADA: Efficient Safety and Context Aware Dose Allocation for Precision Medicine