Quick-Draw Bandits: Quickly Optimizing in Nonstationary Environments with Extremely Many Arms

Derek Everett, Fred Lu, Edward Raff +2

Canonical algorithms for multi-armed bandits typically assume a stationary reward environment where the size of the action space (number of arms) is small. More recently developed…