Publications (23)
Kinematics-Aware Diffusion Policy with Consistent 3D Observation and Action Space for Whole-Arm Robotic Manipulation
Kangchen Lv, Mingrui Yu, Yongyi Jia +2
Whole-body control of robotic manipulators with awareness of full-arm kinematics is crucial for many manipulation scenarios involving body collision avoidance or body-object intera…
UniStateDLO: Unified Generative State Estimation and Tracking of Deformable Linear Objects Under Occlusion for Constrained Manipulation
Kangchen Lv, Mingrui Yu, Shihefeng Wang +2
Perception of deformable linear objects (DLOs), such as cables, ropes, and wires, is the cornerstone for successful downstream manipulation. Although vision-based methods have been…
A Unified Interaction Control Framework for Safe Robotic Ultrasound Scanning with Human-Intention-Aware Compliance
Xiangjie Yan, Shaqi Luo, Yongpeng Jiang +6
The ultrasound scanning robot operates in environments where frequent human-robot interactions occur. Most existing control methods for ultrasound scanning address only one specifi…
A Coarse-to-Fine Framework for Dual-Arm Manipulation of Deformable Linear Objects with Whole-Body Obstacle Avoidance
Mingrui Yu, Kangchen Lv, Changhao Wang +2
Manipulating deformable linear objects (DLOs) to achieve desired shapes in constrained environments with obstacles is a meaningful but challenging task. Global planning is necessar…
Analyzing Key Objectives in Human-to-Robot Retargeting for Dexterous Manipulation
Chendong Xin, Mingrui Yu, Yongpeng Jiang +2
Kinematic retargeting from human hands to robot hands is essential for transferring dexterity from humans to robots in manipulation teleoperation and imitation learning. However, d…
GS-Playground: A High-Throughput Photorealistic Simulator for Vision-Informed Robot Learning
Yufei Jia, Heng Zhang, Ziheng Zhang +39
Embodied AI research is undergoing a shift toward vision-centric perceptual paradigms. While massively parallel simulators have catalyzed breakthroughs in proprioception-based loco…
CoorGrasp: Coordinated Contact Control for Adaptive Dexterous Grasping Under Uncertainty
Mingrui Yu, Yongpeng Jiang, Yongyi Jia +3
While recent research has focused heavily on dexterous grasp pose generation, less attention has been devoted to the execution of planned grasps. Under shape and position uncertain…
Robotic In-Hand Manipulation for Large-Range Precise Object Movement: The RGMC Champion Solution
Mingrui Yu, Yongpeng Jiang, Chen Chen +2
In-hand manipulation using multiple dexterous fingers is a critical robotic skill that can reduce the reliance on large arm motions, thereby saving space and energy. This letter fo…
HUGS: Guiding Unified Dexterous Grasp Synthesis Across Modes and Scales via Learned Human Priors
Mingrui Yu, Yongpeng Jiang, Yongyi Jia +4
Dexterous grasping across diverse object scales requires contact modes ranging from two-finger pinches to bimanual grasps. Existing dexterous grasp synthesis methods reduce the hig…
Robust Model-Based In-Hand Manipulation with Integrated Real-Time Motion-Contact Planning and Tracking
Yongpeng Jiang, Mingrui Yu, Xinghao Zhu +2
Robotic dexterous in-hand manipulation, where multiple fingers dynamically make and break contact, represents a step toward human-like dexterity in real-world robotic applications.…
Learning to Estimate 3-D States of Deformable Linear Objects from Single-Frame Occluded Point Clouds
Kangchen Lv, Mingrui Yu, Yifan Pu +3
Accurately and robustly estimating the state of deformable linear objects (DLOs), such as ropes and wires, is crucial for DLO manipulation and other applications. However, it remai…
Towards Human-level Dexterous Teleoperation
Puhao Li, Zeyuan Chen, Yingying Wu +9
The paper presents TeleDexter, a hand‑object co‑tracking controller that learns to map human teleoperation intent into low‑level contact actions for dexterous robot hands, achievin…
Generalizable whole-body global manipulation of deformable linear objects by dual-arm robot in 3-D constrained environments
Mingrui Yu, Kangchen Lv, Changhao Wang +3
Constrained environments are common in practical applications of manipulating deformable linear objects (DLOs), where movements of both DLOs and robots should be constrained. This…
Causal World Modeling for Robot Control
Lin Li, Qihang Zhang, Yiming Luo +9
This work highlights that video world modeling, alongside vision-language pre-training, establishes a fresh and independent foundation for robot learning. Intuitively, video world…
Shape Control of Deformable Linear Objects with Offline and Online Learning of Local Linear Deformation Models
Mingrui Yu, Hanzhong Zhong, Xiang Li
The shape control of deformable linear objects (DLOs) is challenging, since it is difficult to obtain the deformation models. Previous studies often approximate the models in purel…
UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms
Yufei Jia, Zhanxiang Cao, Mingrui Yu +48
Simulation-based RL for contemporary robot control is increasingly organized around GPU-resident simulation: physics, rollout collection, and learning are placed on a single GPU-ce…
In-Hand Following of Deformable Linear Objects Using Dexterous Fingers with Tactile Sensing
Mingrui Yu, Boyuan Liang, Xiang Zhang +6
Most research on deformable linear object (DLO) manipulation assumes rigid grasping. However, beyond rigid grasping and re-grasping, in-hand following is also an essential skill th…
Visual Attention Based Cognitive Human-Robot Collaboration for Pedicle Screw Placement in Robot-Assisted Orthopedic Surgery
Chen Chen, Qikai Zou, Yuhang Song +4
Current orthopedic robotic systems largely focus on navigation, aiding surgeons in positioning a guiding tube but still requiring manual drilling and screw placement. The automatio…
Contact-Implicit Model Predictive Control for Dexterous In-hand Manipulation: A Long-Horizon and Robust Approach
Yongpeng Jiang, Mingrui Yu, Xinghao Zhu +2
Dexterous in-hand manipulation is an essential skill of production and life. However, the highly stiff and mutable nature of contacts limits real-time contact detection and inferen…
Global Model Learning for Large Deformation Control of Elastic Deformable Linear Objects: An Efficient and Adaptive Approach
Mingrui Yu, Kangchen Lv, Hanzhong Zhong +2
Robotic manipulation of deformable linear objects (DLOs) has broad application prospects in many fields. However, a key issue is to obtain the exact deformation models (i.e., how r…
HiGS: Hierarchical Generative Scene Framework for Multi-Step Associative Semantic Spatial Composition
Jiacheng Hong, Kunzhen Wu, Mingrui Yu +4
Three-dimensional scene generation holds significant potential in gaming, film, and virtual reality. However, most existing methods adopt a single-step generation process, making i…
EmbodiSteer: Steering Embodiment-Agnostic Visuomotor Policies with Joint-Space Guidance for Zero-Shot Cross-Embodiment Deployment
Shihefeng Wang, Kangchen Lv, Mingrui Yu +1
Scalable robot imitation learning relies on large-scale heterogeneous data from diverse robots or body-free data, making Cartesian end-effector actions a key interface for embodime…
Adaptive Control for Robotic Manipulation of Deformable Linear Objects with Offline and Online Learning of Unknown Models
Mingrui Yu, Hanzhong Zhong, Fangxun Zhong +1
The deformable linear objects (DLOs) are common in both industrial and domestic applications, such as wires, cables, ropes. Because of its highly deformable nature, it is difficult…