3 citations · 8 across the 22 of their papers we have counts for
25 papers
Neuro-Symbolic Predicate Learning for Semantic Safe Robot Control
Zihan Ye, Jiayi Liu, Puze Liu +4
As robots are increasingly deployed in everyday environments, ensuring their safety has become a central challenge. Existing methods often encode safety requirements as opaque math…
Find Something You Can't Do: Agentic Real-World Reinforcement Learning for Self-Improving VLA Models
Yuan Fang, Zechu Li, Haolei Tong +2
Vision--language--action (VLA) models provide strong priors for robotic manipulation but are typically deployed as frozen policies, unable to improve from their own failures. Real-…
Blind Dexterity: Whole-Body Humanoid Manipulation via Pure Proprioception
Aditya Bhatt, Oleg Kaidanov, Puze Liu +1
We present blind, whole-body manipulation skills on a Unitree G1 humanoid using only onboard proprioception, without cameras, markers, force-torque, or tactile sensors. Despite thi…
Directional Constraints for Efficient Exploration in Safe Reinforcement Learning
Paolo Magliano, Puze Liu, Jan Peters +2
Reinforcement Learning has revolutionized the landscape of robotic research, allowing robust learning of complex robotic skills in simulation. However, real-world deployment in ope…
Scalable Multi-Task Data Generation via Reinforcement Learning for Language-Conditioned Bimanual Dexterous Manipulation
Zechu Li, Yufeng Jin, Puze Liu +2
A key bottleneck in training generalist policies for bimanual dexterous manipulation is the lack of large-scale, high-quality datasets. Synthetic data generation in simulation prov…
HARBOR: A Harness Framework for Agentic Robot Reinforcement Learning
Zechu Li, Yufeng Jin, Xiaoyang Liu +4
Reinforcement learning (RL) has become a powerful paradigm for robot learning, particularly in sim-to-real settings, but its broader adoption remains limited by the engineering pip…
Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking
Alessandro Montenegro, Shihao Li, Puze Liu +2
Enabling humanoid robots to operate in complex, dynamic environments remains a critical challenge, fundamentally limited by the ability to navigate robustly, safely, and accurately…
CompliantVLA-adaptor: VLM-Guided Variable Impedance Action for Safe Contact-Rich Manipulation
Heng Zhang, Wei-Hsing Huang, Qiyi Tong +7
We propose a CompliantVLA-adaptor that augments the state-of-the-art Vision-Language-Action (VLA) models with vision-language model (VLM)-informed context-aware variable impedance…
Maximum Total Correlation Reinforcement Learning
Bang You, Puze Liu, Huaping Liu +2
Simplicity is a powerful inductive bias. In reinforcement learning, regularization is used for simpler policies, data augmentation for simpler representations, and sparse reward fu…
Towards Safe Robot Foundation Models Using Inductive Biases
Maximilian Tölle, Theo Gruner, Daniel Palenicek +6
Safety is a critical requirement for the real-world deployment of robotic systems. Unfortunately, while current robot foundation models show promising generalization capabilities a…
Morphologically Symmetric Reinforcement Learning for Ambidextrous Bimanual Manipulation
Zechu Li, Yufeng Jin, Daniel Ordonez Apraez +3
Humans naturally exhibit bilateral symmetry in their gross manipulation skills, effortlessly mirroring simple actions between left and right hands. Bimanual robots-which also featu…
Towards Safe Robot Foundation Models
Maximilian Tölle, Theo Gruner, Daniel Palenicek +5
Robot foundation models hold the potential for deployment across diverse environments, from industrial applications to household tasks. While current research focuses primarily on…
A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics
Puze Liu, Jonas Günster, Niklas Funk +17
Machine learning methods have a groundbreaking impact in many application domains, but their application on real robotic platforms is still limited. Despite the many challenges ass…
Handling Long-Term Safety and Uncertainty in Safe Reinforcement Learning
Jonas Günster, Puze Liu, Jan Peters +1
Safety is one of the key issues preventing the deployment of reinforcement learning techniques in real-world robots. While most approaches in the Safe Reinforcement Learning area d…
Adaptive Control based Friction Estimation for Tracking Control of Robot Manipulators
Junning Huang, Davide Tateo, Puze Liu +1
Adaptive control is often used for friction compensation in trajectory tracking tasks because it does not require torque sensors. However, it has some drawbacks: first, the most co…
Bridging the gap between Learning-to-plan, Motion Primitives and Safe Reinforcement Learning
Piotr Kicki, Davide Tateo, Puze Liu +3
Trajectory planning under kinodynamic constraints is fundamental for advanced robotics applications that require dexterous, reactive, and rapid skills in complex environments. Thes…
ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoning
Christopher E. Mower, Yuhui Wan, Hongzhan Yu +20
We present a framework for intuitive robot programming by non-experts, leveraging natural language prompts and contextual information from the Robot Operating System (ROS). Our sys…
Distilling Contact Planning for Fast Trajectory Optimization in Robot Air Hockey
Julius Jankowski, Ante Marić, Puze Liu +3
Robot control through contact is challenging as it requires reasoning over long horizons and discontinuous system dynamics. Highly dynamic tasks such as Air Hockey additionally req…
Safe Reinforcement Learning on the Constraint Manifold: Theory and Applications
Puze Liu, Haitham Bou-Ammar, Jan Peters +1
Integrating learning-based techniques, especially reinforcement learning, into robotics is promising for solving complex problems in unstructured environments. However, most existi…
Fast Kinodynamic Planning on the Constraint Manifold with Deep Neural Networks
Piotr Kicki, Puze Liu, Davide Tateo +4
Motion planning is a mature area of research in robotics with many well-established methods based on optimization or sampling the state space, suitable for solving kinematic motion…
Safe Reinforcement Learning of Dynamic High-Dimensional Robotic Tasks: Navigation, Manipulation, Interaction
Puze Liu, Kuo Zhang, Davide Tateo +4
Safety is a crucial property of every robotic platform: any control policy should always comply with actuator limits and avoid collisions with the environment and humans. In reinfo…
Dimensionality Reduction and Prioritized Exploration for Policy Search
Marius Memmel, Puze Liu, Davide Tateo +1
Black-box policy optimization is a class of reinforcement learning algorithms that explores and updates the policies at the parameter level. This class of algorithms is widely appl…
Regularized Deep Signed Distance Fields for Reactive Motion Generation
Puze Liu, Kuo Zhang, Davide Tateo +3
Autonomous robots should operate in real-world dynamic environments and collaborate with humans in tight spaces. A key component for allowing robots to leave structured lab and man…
Efficient and Reactive Planning for High Speed Robot Air Hockey
Puze Liu, Davide Tateo, Haitham Bou-Ammar +1
Highly dynamic robotic tasks require high-speed and reactive robots. These tasks are particularly challenging due to the physical constraints, hardware limitations, and the high un…