6 papers
TouchFusion: Multimodal Wristband Sensing for Ubiquitous Touch Interactions
Eric Whitmire, Evan Strasnick, Roger Boldu +11
TouchFusion is a wristband that enables touch interactions on nearby surfaces without any additional instrumentation or computer vision. TouchFusion combines surface electromyograp…
STAR: Smartphone-analogous Typing in Augmented Reality
Taejun Kim, Amy Karlson, Aakar Gupta +6
While text entry is an essential and frequent task in Augmented Reality (AR) applications, devising an efficient and easy-to-use text entry method for AR remains an open challenge.…
RingGesture: A Ring-Based Mid-Air Gesture Typing System Powered by a Deep-Learning Word Prediction Framework
Junxiao Shen, Roger Boldu, Arpit Kalla +2
Text entry is a critical capability for any modern computing experience, with lightweight augmented reality (AR) glasses being no exception. Designed for all-day wearability, a lim…
Gesture2Text: A Generalizable Decoder for Word-Gesture Keyboards in XR Through Trajectory Coarse Discretization and Pre-training
Junxiao Shen, Khadija Khaldi, Enmin Zhou +2
Text entry with word-gesture keyboards (WGK) is emerging as a popular method and becoming a key interaction for Extended Reality (XR). However, the diversity of interaction modes,…
Boosting Gesture Recognition with an Automatic Gesture Annotation Framework
Junxiao Shen, Xuhai Xu, Ran Tan +2
Training a real-time gesture recognition model heavily relies on annotated data. However, manual data annotation is costly and demands substantial human effort. In order to address…
Towards Open-World Gesture Recognition
Junxiao Shen, Matthias De Lange, Xuhai "Orson" Xu +7
Providing users with accurate gestural interfaces, such as gesture recognition based on wrist-worn devices, is a key challenge in mixed reality. However, static machine learning pr…