5 papers
Moving Through Clutter: Scaling Data Collection and Benchmarking for 3D Scene-Aware Humanoid Locomotion via Virtual Reality
Beichen Wang, Yuanjie Lu, Linji Wang +2
Recent advances in humanoid locomotion have enabled dynamic behaviors such as dancing, martial arts, and parkour, yet these capabilities are predominantly demonstrated in open, fla…
Reality Copilot: Voice-First Human-AI Collaboration in Mixed Reality Using Large Multimodal Models
Liuchuan Yu, Yongqi Zhang, Lap-Fai Yu
Large Multimodal Models (LMMs) have shown strong potential for assisting users in tasks, such as programming, content creation, and information access, yet their interaction remain…
XRoboToolkit: A Cross-Platform Framework for Robot Teleoperation
Zhigen Zhao, Liuchuan Yu, Ke Jing +1
The rapid advancement of Vision-Language-Action models has created an urgent need for large-scale, high-quality robot demonstration datasets. Although teleoperation is the predomin…
Enriching physical-virtual interaction in AR gaming by tracking identical objects via an egocentric partial observation frame
Liuchuan Yu, Ching-I Huang, Hsueh-Cheng Wang +1
Augmented reality (AR) games, particularly those designed for head-mounted displays, have grown increasingly prevalent. However, most existing systems depend on pre-scanned, static…
Col-Con: A Virtual Reality Simulation Testbed for Exploring Collaborative Behaviors in Construction
Liuchuan Yu, Ching-Yu Cheng, William F Ranc +6
Virtual reality is widely adopted for applications such as training, education, and collaboration. The construction industry, known for its complex projects and numerous personnel…