4 papers
Thresholds for sensitive optimality and Blackwell optimality in stochastic games
Stéphane Gaubert, Julien Grand-Clément, Ricardo D. Katz
We investigate refinements of the mean-payoff criterion in two-player zero-sum perfect-information stochastic games. A strategy is Blackwell optimal if it is optimal in the discoun…
Playing against a stationary opponent
Julien Grand-Clément, Nicolas Vieille
This paper investigates properties of Blackwell -optimal strategies in zero-sum stochastic games when the adversary is restricted to stationary strategies, motivated by applicat…
On Separation Between Best-Iterate, Random-Iterate, and Last-Iterate Convergence of Learning in Games
Yang Cai, Gabriele Farina, Julien Grand-Clément +4
Non-ergodic convergence of learning dynamics in games is widely studied recently because of its importance in both theory and practice. Recent work (Cai et al., 2024) showed that a…
Tractable Robust Markov Decision Processes
Julien Grand-Clément, Nian Si, Shengbo Wang
In this paper we investigate the tractability of robust Markov Decision Processes (RMDPs) under various structural assumptions on the uncertainty set. Surprisingly, we show that in…