4 papers
RingGesture: A Ring-Based Mid-Air Gesture Typing System Powered by a Deep-Learning Word Prediction Framework
Junxiao Shen, Roger Boldu, Arpit Kalla +2
Text entry is a critical capability for any modern computing experience, with lightweight augmented reality (AR) glasses being no exception. Designed for all-day wearability, a lim…
Gesture2Text: A Generalizable Decoder for Word-Gesture Keyboards in XR Through Trajectory Coarse Discretization and Pre-training
Junxiao Shen, Khadija Khaldi, Enmin Zhou +2
Text entry with word-gesture keyboards (WGK) is emerging as a popular method and becoming a key interaction for Extended Reality (XR). However, the diversity of interaction modes,…
Boosting Gesture Recognition with an Automatic Gesture Annotation Framework
Junxiao Shen, Xuhai Xu, Ran Tan +2
Training a real-time gesture recognition model heavily relies on annotated data. However, manual data annotation is costly and demands substantial human effort. In order to address…
Towards Open-World Gesture Recognition
Junxiao Shen, Matthias De Lange, Xuhai "Orson" Xu +7
Providing users with accurate gestural interfaces, such as gesture recognition based on wrist-worn devices, is a key challenge in mixed reality. However, static machine learning pr…