5 papers
Learning Multi-Stage Pick-and-Place with a Legged Mobile Manipulator
Haichao Zhang, Haonan Yu, Le Zhao +4
Quadruped-based mobile manipulation presents significant challenges in robotics due to the diversity of required skills, the extended task horizon, and partial observability. After…
SLIM: Sim-to-Real Legged Instructive Manipulation via Long-Horizon Visuomotor Learning
Haichao Zhang, Haonan Yu, Le Zhao +4
We present a low-cost legged mobile manipulation system that solves long-horizon real-world tasks, trained by reinforcement learning purely in simulation. This system is made possi…
Robot Policy Learning with Temporal Optimal Transport Reward
Yuwei Fu, Haichao Zhang, Di Wu +2
Reward specification is one of the most tricky problems in Reinforcement Learning, which usually requires tedious hand engineering in practice. One promising approach to tackle thi…
Solving Motion Planning Tasks with a Scalable Generative Model
Yihan Hu, Siqi Chai, Zhening Yang +6
As autonomous driving systems being deployed to millions of vehicles, there is a pressing need of improving the system's scalability, safety and reducing the engineering cost. A re…
FuRL: Visual-Language Models as Fuzzy Rewards for Reinforcement Learning
Yuwei Fu, Haichao Zhang, Di Wu +2
In this work, we investigate how to leverage pre-trained visual-language models (VLM) for online Reinforcement Learning (RL). In particular, we focus on sparse reward tasks with pr…