Pooling and Drift in Delayed Bandits

Melika Baghi

A system often has to act long before it learns whether the act worked: a recommender sees a click in seconds and a purchase in days. With $K$ actions and a delay of $d$ rounds, th…