5 papers
SoniSpeech: A Large-Scale Open-Vocabulary Tri-Modal Dataset for Wearable Silent Speech Interfaces
Ruidong Zhang, Jiacheng Liu, François Guimbretière +1
Wearable silent speech interfaces (SSIs) are limited to small, closed vocabularies. Approaches achieving larger vocabularies require obtrusive hardware such as facial electrodes. W…
WatchHand: Enabling Continuous Hand Pose Tracking On Off-the-Shelf Smartwatches
Jiwan Kim, Chi-Jung Lee, Hohurn Jung +4
Tracking hand poses on wrist-wearables enables rich, expressive interactions, yet remains unavailable on commercial smartwatches, as prior implementations rely on external sensors…
"Why the face?": Exploring Robot Error Detection Using Instrumented Bystander Reactions
Maria Teresa Parreira, Ruidong Zhang, Sukruth Gowdru Lingaraju +7
How do humans recognize and rectify social missteps? We achieve social competence by looking around at our peers, decoding subtle cues from bystanders - a raised eyebrow, a laugh -…
Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand
Chi-Jung Lee, Jiaxin Li, Tianhong Catherine Yu +4
As computing devices become increasingly integrated into daily life, there is a growing need for intuitive, always-available interaction methods, even when users' hands are occupie…
ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Wave Around the Body
Saif Mahmud, Vineet Parikh, Qikang Liang +7
We present ActSonic, an intelligent, low-power active acoustic sensing system integrated into eyeglasses that can recognize 27 different everyday activities (e.g., eating, drinking…