Reference-Based Manipulation: A Framework and Pipeline for Multimodal Spatial Reasoning

Yangyang He, Zhuangze Hou, Yonglin Chen +1

When manipulating objects in immersive platforms through speech and gesture, users naturally construct spatial references, referring to scene entities, their bodies, or the environ…