5 papers
Real-World Reinforcement Learning of Active Perception Behaviors
Edward S. Hu, Jie Wang, Xingfang Yuan +5
A robot's instantaneous sensory observations do not always reveal task-relevant state information. Under such partial observability, optimal behavior typically involves explicitly…
Compute-Optimal Scaling for Value-Based Deep RL
Preston Fu, Oleh Rybkin, Zhiyuan Zhou +4
As models grow larger and training them becomes expensive, it becomes increasingly important to scale training recipes not just to larger models and more data, but to do so in a co…
Value-Based Deep RL Scales Predictably
Oleh Rybkin, Michal Nauman, Preston Fu +4
Scaling data and compute is critical to the success of modern ML. However, scaling demands predictability: we want methods to not only perform well with more compute or data, but a…
Latent Diffusion Planning for Imitation Learning
Amber Xie, Oleh Rybkin, Dorsa Sadigh +1
Recent progress in imitation learning has been enabled by policy architectures that scale to complex visuomotor tasks, multimodal distributions, and large datasets. However, these…
Video2Policy: Scaling up Manipulation Tasks in Simulation through Internet Videos
Weirui Ye, Fangchen Liu, Zheng Ding +3
Simulation offers a promising approach for cheaply scaling training data for generalist policies. To scalably generate data from diverse and realistic tasks, existing algorithms ei…