4 papers
TQL: Scaling Q-Functions with Transformers by Preventing Attention Collapse
Perry Dong, Kuo-Han Hung, Alexander Swerdlow +2
Despite scale driving substantial recent advancements in machine learning, reinforcement learning (RL) methods still primarily use small value functions. Naively scaling value func…
Posterior Behavioral Cloning: Pretraining BC Policies for Efficient RL Finetuning
Andrew Wagenmaker, Perry Dong, Raymond Tsao +2
Standard practice across domains from robotics to language is to first pretrain a policy on a large-scale demonstration dataset, and then finetune this policy, typically with reinf…
Reinforcement Learning via Implicit Imitation Guidance
Perry Dong, Alec M. Lessing, Annie S. Chen +1
We study the problem of sample efficient reinforcement learning, where prior data such as demonstrations are provided for initialization in lieu of a dense reward signal. A natural…
What Matters for Batch Online Reinforcement Learning in Robotics?
Perry Dong, Suvir Mirchandani, Dorsa Sadigh +1
The ability to learn from large batches of autonomously collected data for policy improvement -- a paradigm we refer to as batch online reinforcement learning -- holds the promise…