6 papers
TrustRoboReward: Preference-Ordered Isotonic Score Editing for Multi-Paradigm Robot Reward Models
Yidong Wang, Yan Zhan, Ziteng Feng +16
Reward models are a bottleneck for reinforcement learning in embodied AI. Long-horizon robotic manipulation requires scalable vision feedback beyond handcrafted rewards or task-spe…
Preference-Calibrated Human-in-the-Loop Reinforcement Learning for Robotic Manipulation
Zeyi Liu, Guangyao Liu, Yinuo Qu +6
Human-in-the-loop reinforcement learning (HIL-RL) improves sample efficiency in real-robot manipulation through online human intervention. However, successful trajectories may incl…
WorldSample: Closed-loop Real-robot RL with World Modelling
Yuquan Xue, Le Xu, Zeyi Liu +5
Reinforcement learning (RL) can overcome the demonstration-coverage limitation of imitation learning (IL) by allowing robots to improve through trial-and-error interaction beyond t…
RESample: A Robust Data Augmentation Framework via Exploratory Sampling for Robotic Manipulation
Yuquan Xue, Guanxing Lu, Zhenyu Wu +4
Vision-Language-Action (VLA) models have shown strong manipulation capability when trained with large-scale imitation learning datasets. However, these datasets that predominantly…
OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulation
Can Cui, Pengxiang Ding, Wenxuan Song +10
Dual-system VLA (Vision-Language-Action) architectures have become a hot topic in embodied intelligence research, but there is a lack of sufficient open-source work for further per…
Score and Distribution Matching Policy: Advanced Accelerated Visuomotor Policies via Matched Distillation
Bofang Jia, Pengxiang Ding, Can Cui +5
Visual-motor policy learning has advanced with architectures like diffusion-based policies, known for modeling complex robotic trajectories. However, their prolonged inference time…