Nonpreemptive Scheduling While Learning Context-Dependent Service Rates

Wansoo Choi, Seoungbin Bae, Dabeen Lee

We study nonpreemptive contextual queueing bandits in a single-server system. Each job is represented by a $d$-dimensional context vector; in each round, a job may arrive with its…