Benefits and Costs of Adaptive Sampling

Yu-Shiou Willy Lin, Dae Woong Ham, Iavor Bojinov

Multi-armed bandits are widely used for sequential experimentation in clinical trials, recommendation systems, and online platforms. While regret minimization and valid inference f…