Non-Stationary Dueling Bandits Under a Weighted Borda Criterion

Joe Suk, Arpit Agarwal

In $K$-armed dueling bandits, the learner receives preference feedback between arms, and the regret of an arm is defined in terms of its suboptimality to a $\text{winner}$ arm. T…