3.4k citations · 9.9k across the 108 of their papers we have counts for
7 papers · 1 filter
Taylor Expansion of Discount Factors
Yunhao Tang, Mark Rowland, Rémi Munos +1
In practical reinforcement learning (RL), the discount factor used for estimating value functions often differs from that used for defining the evaluation objective. In this work,…
Model-Free Learning for Two-Player Zero-Sum Partially Observable Markov Games with Perfect Recall
Tadashi Kozuno, Pierre Ménard, Rémi Munos +1
We study the problem of learning a Nash equilibrium (NE) in an imperfect information game (IIG) through self-play. Precisely, we focus on two-player, zero-sum, episodic, tabular II…
Unifying Gradient Estimators for Meta-Reinforcement Learning via Off-Policy Evaluation
Yunhao Tang, Tadashi Kozuno, Mark Rowland +2
Model-agnostic meta-reinforcement learning requires estimating the Hessian matrix of value functions. This is challenging from an implementation perspective, as repeatedly differen…
Concave Utility Reinforcement Learning: the Mean-Field Game Viewpoint
Matthieu Geist, Julien Pérolat, Mathieu Laurière +5
Concave Utility Reinforcement Learning (CURL) extends RL from linear to concave utilities in the occupancy measure induced by the agent's policy. This encompasses not only RL but a…
Revisiting Peng's Q() for Modern Reinforcement Learning
Tadashi Kozuno, Yunhao Tang, Mark Rowland +5
Off-policy multi-step reinforcement learning algorithms consist of conservative and non-conservative algorithms: the former actively cut traces, whereas the latter do not. Recently…
Large-Scale Representation Learning on Graphs via Bootstrapping
Shantanu Thakoor, Corentin Tallec, Mohammad Gheshlaghi Azar +5
Self-supervised learning provides a promising path towards eliminating the need for costly label information in representation learning on graphs. However, to achieve state-of-the-…