3 citations · 8 across the 37 of their papers we have counts for
41 papers
Revealing Structured Heterogeneity
Christopher Turansick
In this paper, we study models of restricted heterogeneity. While the random utility model allows for arbitrary heterogeneity among rational types, we consider the case when an ana…
Encoded but Not in Control: Revealing the Grounding Gap in Vision-Language Robot Policies
Shaohan Jiang, Jiahang Cao, Qiduo He +9
Instruction following is central to language-conditioned robot policies: language should determine what to do when the same scene permits multiple valid actions. Yet successful exe…
Vela: Scaling Vision-Language-Action Models with Adaptive Action Curve Parametrization
Yifan Li, Jiaxu Wang, Dongming Wu +4
Most vision-language-action models represent future motion as fixed-rate action chunks, tying temporal resolution and prediction horizon to a fixed output budget. This pointwise re…
AR-WAM: A Visual-Conditioned Agent-Ready World Action Model for Robotic Manipulation
Yicheng Jiang, Zesen Gan, Xiaobo Wang +8
As AI agents become increasingly capable, agent-driven robotic control is emerging as a compelling paradigm. However, prevailing vision-language-action (VLA) models and world actio…
SOLO: Stable Omni-terrain Long-Horizon Perceptive Humanoid Locomotion
Pihai Sun, Gang Han, Jingkai Sun +17
Humans traverse complex terrain over long distances without losing balance, whereas perceptive humanoid policies become fragile as perception and control errors accumulate. We pres…
-VLA: a Hierarchical Robot Foundation Model with World-Model-Guided Test-Time Computation
Xiaowei Cai, Yunuo Cai, Bingao Chen +36
Long-horizon robot manipulation requires a robot to both execute individual skills reliably and sequence them coherently over extended tasks. Most hierarchical vision-language-acti…
Agentic RAG-VLM: Affordance-Aware Retrieval-Augmented Generation with Self-Reflective Planning for Robotic Grasping
Tao Chen, Lizheng Liu, Jiaxu Wang +4
Generalizable robotic grasping in cluttered environments is essential for deploying manipulators in unstructured human spaces, yet existing VLM-based methods rely on visual similar…
-WM: A Unified Video-Action World Model for Robotic Manipulation
Pengfei Zhou, Shengcong Chen, Di Chen +17
Robotic manipulation requires models that generate executable actions while anticipating and evaluating their future consequences before physical execution. We present -World…
MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropy
Jiaxu Wang, Junhao He, Jingkai Sun +5
Learning real-world dynamics from visual observations is crucial for various domains. A common strategy is to calibrate simulators by estimating physical parameters, yet accuracy i…
Learning Structural Latent Points for Efficient Visual Representations in Robotic Manipulation
Yicheng Jiang, Jiaxu Wang, Junhao He +8
Current 3D-aware pretraining methods for embodied perception and manipulation are largely built on differentiable rendering frameworks, producing either fully implicit neural field…
Sparse View Distractor-Free Gaussian Splatting
Yi Gu, Zhaorui Wang, Jiahang Cao +4
3D Gaussian Splatting (3DGS) enables efficient training and fast novel view synthesis in static environments. To address challenges posed by transient objects, distractor-free 3DGS…
MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstruction
Qiang Zhang, Jiahao Ma, Peiran Liu +20
Humanoid motion control has witnessed significant breakthroughs in recent years, with deep reinforcement learning (RL) emerging as a primary catalyst for achieving complex, human-l…
MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation
Jiaxu Wang, Yicheng Jiang, Tianlun He +8
World-model-based imagine-then-act becomes a promising paradigm for robotic manipulation, yet existing approaches typically support either purely image-based forecasting or reasoni…
DEGS: Deformable Event-based 3D Gaussian Splatting from RGB and Event Stream
Junhao He, Jiaxu Wang, Jia Li +7
Reconstructing Dynamic 3D Gaussian Splatting (3DGS) from low-framerate RGB videos is challenging. This is because large inter-frame motions will increase the uncertainty of the sol…
DPL: Depth-only Perceptive Humanoid Locomotion via Realistic Depth Synthesis and Cross-Attention Terrain Reconstruction
Jingkai Sun, Gang Han, Pihai Sun +5
Recent advancements in legged robot perceptive locomotion have shown promising progress. However, terrain-aware humanoid locomotion remains largely constrained to two paradigms: de…
Compose Your Policies! Improving Diffusion-based or Flow-based Robot Policies via Test-time Distribution-level Composition
Jiahang Cao, Yize Huang, Hanzhong Guo +15
Diffusion-based models for robotic control, including vision-language-action (VLA) and vision-action (VA) policies, have demonstrated significant capabilities. Yet their advancemen…
Humanoid Occupancy: Enabling A Generalized Multimodal Occupancy Perception System on Humanoid Robots
Wei Cui, Haoyu Wang, Wenkang Qin +19
Humanoid robot technology is advancing rapidly, with manufacturers introducing diverse heterogeneous visual perception modules tailored to specific scenarios. Among various percept…
Learning Null Geodesics for Gravitational Lensing Rendering in General Relativity
Mingyuan Sun, Zheng Fang, Jiaxu Wang +3
We present GravLensX, an innovative method for rendering black holes with gravitational lensing effects using neural networks. The methodology involves training neural networks to…
Occupancy World Model for Robots
Zhang Zhang, Qiang Zhang, Wei Cui +12
Understanding and forecasting the scene evolutions deeply affect the exploration and decision of embodied agents. While traditional methods simulate scene evolutions through trajec…
Modality-Composable Diffusion Policy via Inference-Time Distribution-level Composition
Jiahang Cao, Qiang Zhang, Hanzhong Guo +3
Diffusion Policy (DP) has attracted significant attention as an effective method for policy representation due to its capacity to model multi-distribution dynamics. However, curren…
EmbodiedVSR: Dynamic Scene Graph-Guided Chain-of-Thought Reasoning for Visual Spatial Tasks
Yi Zhang, Qiang Zhang, Xiaozhu Ju +13
While multimodal large language models (MLLMs) have made groundbreaking progress in embodied intelligence, they still face significant challenges in spatial reasoning for complex l…
HumanoidPano: Hybrid Spherical Panoramic-LiDAR Cross-Modal Perception for Humanoid Robots
Qiang Zhang, Zhang Zhang, Wei Cui +13
The perceptual system design for humanoid robots poses unique challenges due to inherent structural constraints that cause severe self-occlusion and limited field-of-view (FOV). We…
LiPS: Large-Scale Humanoid Robot Reinforcement Learning with Parallel-Series Structures
Qiang Zhang, Gang Han, Jingkai Sun +7
In recent years, research on humanoid robots has garnered significant attention, particularly in reinforcement learning based control algorithms, which have achieved major breakthr…
Trinity: A Modular Humanoid Robot AI System
Jingkai Sun, Qiang Zhang, Gang Han +7
In recent years, research on humanoid robots has garnered increasing attention. With breakthroughs in various types of artificial intelligence algorithms, embodied intelligence, ex…