4 papers · 1 filter
DiffusionNFT: Online Diffusion Reinforcement with Forward Process
Kaiwen Zheng, Huayu Chen, Haotian Ye +7
Online reinforcement learning (RL) has been central to post-training language models, but its extension to diffusion models remains challenging due to intractable likelihoods. Rece…
Nightmare Dreamer: Dreaming About Unsafe States And Planning Ahead
Oluwatosin Oseni, Shengjie Wang, Jun Zhu +1
Reinforcement Learning (RL) has shown remarkable success in real-world applications, particularly in robotics control. However, RL adoption remains limited due to insufficient safe…
When a Reinforcement Learning Agent Encounters Unknown Unknowns
Juntian Zhu, Miguel de Carvalho, Zhouwang Yang +1
An AI agent might surprisingly find she has reached an unknown state which she has never been aware of -- an unknown unknown. We mathematically ground this scenario in reinforcemen…
Aligning Diffusion Behaviors with Q-functions for Efficient Continuous Control
Huayu Chen, Kaiwen Zheng, Hang Su +1
Drawing upon recent advances in language model alignment, we formulate offline Reinforcement Learning as a two-stage optimization problem: First pretraining expressive generative p…