10 papers
Enhancing VLM Reward Models Through Structure-Aware Fine-Tuning
Pyrros Koussios, Chenhao Li, Xin Chen +1
Designing effective reward functions remains a major bottleneck in Reinforcement Learning (RL). Recent work uses large foundation Vision-Language Models (VLMs) as reward models, co…
Uncertainty Quantification for Flow-Based Generalist Robot Policies
Ralf Römer, Maximilian Seeliger, Saida Liu +5
Generalist robot policies, such as vision-language-action models (VLAs) and world-action models (WAMs), combine powerful pretrained backbones with expressive generative action head…
Model-Based Reinforcement Learning for Control under Time-Varying Dynamics
Klemens Iten, Bruce Lee, Chenhao Li +3
Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions.…
What Matters for Simulation to Online Reinforcement Learning on Real Robots
Yarden As, Dhruva Tirumala, René Zurbrügg +4
We investigate what specific design choices enable successful online reinforcement learning (RL) on physical robots. Across 100 real-world training runs on three distinct robotic p…
Learning Soft Robotic Dynamics with Active Exploration
Hehui Zheng, Bhavya Sukhija, Chenhao Li +3
Soft robots offer unmatched adaptability and safety in unstructured environments, yet their compliant, high-dimensional, and nonlinear dynamics make modeling for control notoriousl…
Feature-Based vs. GAN-Based Learning from Demonstrations: When and Why
Chenhao Li, Marco Hutter, Andreas Krause
This survey provides a comparative analysis of feature-based and GAN-based approaches to learning from demonstrations, with a focus on the structure of reward functions and their i…
Uncertainty-Aware Robotic World Model Makes Offline Model-Based Reinforcement Learning Work on Real Robots
Chenhao Li, Andreas Krause, Marco Hutter
Reinforcement Learning (RL) has achieved impressive results in robotics, yet high-performing pipelines remain highly task-specific, with little reuse of prior data. Offline Model-b…
NIL: No-data Imitation Learning by Leveraging Pre-trained Video Diffusion Models
Mert Albaba, Chenhao Li, Markos Diomataris +3
Acquiring physically plausible motor skills across diverse and unconventional morphologies-including humanoid robots, quadrupeds, and animals-is essential for advancing character s…
Symmetry-Guided Memory Augmentation for Efficient Locomotion Learning
Kaixi Bao, Chenhao Li, Yarden As +2
Training reinforcement learning (RL) policies for legged locomotion often requires extensive environment interactions, which are costly and time-consuming. We propose Symmetry-Guid…
Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Robotics
Chenhao Li, Andreas Krause, Marco Hutter
Learning robust and generalizable world models is crucial for enabling efficient and scalable robotic control in real-world environments. In this work, we introduce a novel framewo…