6 papers · 1 filter
Sparse Delta Memory: Scaling the State of Linear RNNs through Sparsity
Loïc Cabannes, Pierre-Emmanuel Mazaré, Gergely Szilvasy +6
Linear attention models allow a fixed state size and a fixed amount of compute per token. However, due to their limited state size, linear attention models fall behind in long-cont…
Survival Reinforcement Learning: Toward Scalable Self-Supervised RL
Franki Nguimatsia-Tiofack, Fabian Schramm, Théotime Le Hellard +1
While self-supervised Contrastive Reinforcement Learning (CRL) has shown remarkable depth-scaling capabilities, successfully using networks over 64 layers, scaled CRL still struggl…
SVL: Goal-Conditioned Reinforcement Learning as Survival Learning
Franki Nguimatsia Tiofack, Fabian Schramm, Théotime Le Hellard +1
Standard approaches to goal-conditioned reinforcement learning (GCRL) that rely on temporal-difference learning can be unstable and sample-inefficient due to bootstrapping. While r…
Accelerating trajectory optimization with Sobolev-trained diffusion policies
Théotime Le Hellard, Franki Nguimatsia Tiofack, Quentin Le Lidec +1
Trajectory Optimization (TO) solvers exploit known system dynamics to compute locally optimal trajectories through iterative improvements. A downside is that each new problem insta…
Guided Flow Policy: Learning from High-Value Actions in Offline Reinforcement Learning
Franki Nguimatsia Tiofack, Théotime Le Hellard, Fabian Schramm +2
Offline reinforcement learning often relies on behavior regularization that enforces policies to remain close to the dataset distribution. However, such approaches fail to distingu…
First-order Sobolev Reinforcement Learning
Fabian Schramm, Nicolas Perrin-Gilbert, Justin Carpentier
We propose a refinement of temporal-difference learning that enforces first-order Bellman consistency: the learned value function is trained to match not only the Bellman targets i…