15 citations · 15 across the 2 of their papers we have counts for
2 papers
cs.CC2022★ 15 cited
Testing Indexability and Computing Whittle and Gittins Index in Subcubic Time
Nicolas Gast, Bruno Gaujal, Kimang Khun
Whittle index is a generalization of Gittins index that provides very efficient allocation rules for restless multi-armed bandits. In this work, we develop an algorithm to test the…
cs.LG2021
Reinforcement Learning for Markovian Bandits: Is Posterior Sampling more Scalable than Optimism?
Nicolas Gast, Bruno Gaujal, Kimang Khun
We study learning algorithms for the classical Markovian bandit problem with discount. We explain how to adapt PSRL [24] and UCRL2 [2] to exploit the problem structure. These varia…