HandPad: A Bimanual Hand Interface for Fluid Window Interactions in VR
arXiv:2607.11807
HandPad is a bare‑hand interface for VR that uses the non‑dominant hand to set spatial frames and modes while the dominant hand performs precise window interactions, enabling device‑free, ergonomic multitasking in virtual environments.
Abstract
Virtual Reality (VR) offers potential for productivity work by creating expansive displays anywhere, yet current systems often rely on external input devices that limit the on-the-go use of mobile VR. We introduce HandPad, a suite of bare-hand interaction techniques that leverage the benefits of asymmetric bimanual coordination and self-haptic support. HandPad assigns the non-dominant hand (NDH) to establish spatial frames and interaction contexts, while the dominant hand (DH) performs fine-grained manipulation. Users can use NDH gestures as an input modifier to change the mode and target of DH interactions, including multi-window navigation, in-window content interaction, and window management. The palm surface of the NDH also serves as a physical touch surface, providing passive haptic feedback for effective DH touch interaction. Both hands and their interactions are spatially remapped to the window surface, enabling comfortable and direct interaction with virtual content. An exploratory study showed that HandPad enables efficient and ergonomic interaction, demonstrating its potential as a device-free approach for knowledge work in VR.
Project page link: https://handpad.github.io/