3 citations · 9 across the 30 of their papers we have counts for
31 papers
Encoded but Not in Control: Revealing the Grounding Gap in Vision-Language Robot Policies
Shaohan Jiang, Jiahang Cao, Qiduo He +9
Instruction following is central to language-conditioned robot policies: language should determine what to do when the same scene permits multiple valid actions. Yet successful exe…
SOLO: Stable Omni-terrain Long-Horizon Perceptive Humanoid Locomotion
Pihai Sun, Gang Han, Jingkai Sun +17
Humans traverse complex terrain over long distances without losing balance, whereas perceptive humanoid policies become fragile as perception and control errors accumulate. We pres…
MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropy
Jiaxu Wang, Junhao He, Jingkai Sun +5
Learning real-world dynamics from visual observations is crucial for various domains. A common strategy is to calibrate simulators by estimating physical parameters, yet accuracy i…
Learning Structural Latent Points for Efficient Visual Representations in Robotic Manipulation
Yicheng Jiang, Jiaxu Wang, Junhao He +8
Current 3D-aware pretraining methods for embodied perception and manipulation are largely built on differentiable rendering frameworks, producing either fully implicit neural field…
Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Control
Zelin Tao, Zeran Su, Peiran Liu +13
Achieving general-purpose humanoid control requires a delicate balance between the precise execution of commanded motions and the flexible, anthropomorphic adaptability needed to r…
MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstruction
Qiang Zhang, Jiahao Ma, Peiran Liu +20
Humanoid motion control has witnessed significant breakthroughs in recent years, with deep reinforcement learning (RL) emerging as a primary catalyst for achieving complex, human-l…
Learning Human-Like Badminton Skills for Humanoid Robots
Yeke Chen, Shihao Dong, Xiaoyu Ji +12
Realizing versatile and human-like performance in high-demand sports like badminton remains a formidable challenge for humanoid robotics. Unlike standard locomotion or static manip…
MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation
Jiaxu Wang, Yicheng Jiang, Tianlun He +8
World-model-based imagine-then-act becomes a promising paradigm for robotic manipulation, yet existing approaches typically support either purely image-based forecasting or reasoni…
DEGS: Deformable Event-based 3D Gaussian Splatting from RGB and Event Stream
Junhao He, Jiaxu Wang, Jia Li +7
Reconstructing Dynamic 3D Gaussian Splatting (3DGS) from low-framerate RGB videos is challenging. This is because large inter-frame motions will increase the uncertainty of the sol…
DPL: Depth-only Perceptive Humanoid Locomotion via Realistic Depth Synthesis and Cross-Attention Terrain Reconstruction
Jingkai Sun, Gang Han, Pihai Sun +5
Recent advancements in legged robot perceptive locomotion have shown promising progress. However, terrain-aware humanoid locomotion remains largely constrained to two paradigms: de…
Compose Your Policies! Improving Diffusion-based or Flow-based Robot Policies via Test-time Distribution-level Composition
Jiahang Cao, Yize Huang, Hanzhong Guo +15
Diffusion-based models for robotic control, including vision-language-action (VLA) and vision-action (VA) policies, have demonstrated significant capabilities. Yet their advancemen…
LHM-Humanoid: Long-Horizon Human Motion Control for Continuous Object Transport in Cluttered Scenes
Haozhuo Zhang, Jingkai Sun, Michele Caprio +5
Physics-based human motion control can make a simulated character walk, sit, and manipulate objects with high physical realism. Almost always, though, this happens in short, isolat…
Humanoid Occupancy: Enabling A Generalized Multimodal Occupancy Perception System on Humanoid Robots
Wei Cui, Haoyu Wang, Wenkang Qin +19
Humanoid robot technology is advancing rapidly, with manufacturers introducing diverse heterogeneous visual perception modules tailored to specific scenarios. Among various percept…
Occupancy World Model for Robots
Zhang Zhang, Qiang Zhang, Wei Cui +12
Understanding and forecasting the scene evolutions deeply affect the exploration and decision of embodied agents. While traditional methods simulate scene evolutions through trajec…
ES-Parkour: Advanced Robot Parkour with Bio-inspired Event Camera and Spiking Neural Network
Qiang Zhang, Jiahang Cao, Jingkai Sun +5
In recent years, quadruped robotics has advanced significantly, particularly in perception and motion control via reinforcement learning, enabling complex motions in challenging en…
EmbodiedVSR: Dynamic Scene Graph-Guided Chain-of-Thought Reasoning for Visual Spatial Tasks
Yi Zhang, Qiang Zhang, Xiaozhu Ju +13
While multimodal large language models (MLLMs) have made groundbreaking progress in embodied intelligence, they still face significant challenges in spatial reasoning for complex l…
HumanoidPano: Hybrid Spherical Panoramic-LiDAR Cross-Modal Perception for Humanoid Robots
Qiang Zhang, Zhang Zhang, Wei Cui +13
The perceptual system design for humanoid robots poses unique challenges due to inherent structural constraints that cause severe self-occlusion and limited field-of-view (FOV). We…
LiPS: Large-Scale Humanoid Robot Reinforcement Learning with Parallel-Series Structures
Qiang Zhang, Gang Han, Jingkai Sun +7
In recent years, research on humanoid robots has garnered significant attention, particularly in reinforcement learning based control algorithms, which have achieved major breakthr…
Trinity: A Modular Humanoid Robot AI System
Jingkai Sun, Qiang Zhang, Gang Han +7
In recent years, research on humanoid robots has garnered increasing attention. With breakthroughs in various types of artificial intelligence algorithms, embodied intelligence, ex…
Distillation-PPO: A Novel Two-Stage Reinforcement Learning Framework for Humanoid Robot Perceptive Locomotion
Qiang Zhang, Gang Han, Jingkai Sun +6
In recent years, humanoid robots have garnered significant attention from both academia and industry due to their high adaptability to environments and human-like characteristics.…
Event Masked Autoencoder: Point-wise Action Recognition with Event-Based Cameras
Jingkai Sun, Qiang Zhang, Jiaxu Wang +2
Dynamic vision sensors (DVS) are bio-inspired devices that capture visual information in the form of asynchronous events, which encode changes in pixel intensity with high temporal…
E2H: A Two-Stage Non-Invasive Neural Signal Driven Humanoid Robotic Whole-Body Control Framework
Yiqun Duan, Qiang Zhang, Jinzhao Zhou +9
Recent advancements in humanoid robotics, including the integration of hierarchical reinforcement learning-based control and the utilization of LLM planning, have significantly enh…
DEL: Discrete Element Learner for Learning 3D Particle Dynamics with Neural Rendering
Jiaxu Wang, Jingkai Sun, Junhao He +4
Learning-based simulators show great potential for simulating particle dynamics when 3D groundtruth is available, but per-particle correspondences are not always accessible. The de…
Mamba Policy: Towards Efficient 3D Diffusion Policy with Hybrid Selective State Models
Jiahang Cao, Qiang Zhang, Jingkai Sun +11
Diffusion models have been widely employed in the field of 3D manipulation due to their efficient capability to learn distributions, allowing for precise prediction of action traje…