Offline Reinforcement Learning with Universal Horizon Models

Hojun Chung, Junseo Lee, Songhwai Oh

Model-based reinforcement learning (RL) offers a compelling approach to offline RL by enabling value learning on imagined on-policy trajectories. However, it often suffers from com…