43 citations · 126 across the 11 of their papers we have counts for
12 papers
Synthesizing Ultrasonic Echo Profiles from Text for Open-Vocabulary Silent Speech Recognition
Jiacheng Liu, Ruidong Zhang, François Guimbretière +1
Eyewear that senses articulation with inaudible ultrasound can now recognize silent speech over an open vocabulary, but its accuracy is limited by the cost of training data. We pre…
SoniSpeech: A Large-Scale Open-Vocabulary Tri-Modal Dataset for Wearable Silent Speech Interfaces
Ruidong Zhang, Jiacheng Liu, François Guimbretière +1
Wearable silent speech interfaces (SSIs) are limited to small, closed vocabularies. Approaches achieving larger vocabularies require obtrusive hardware such as facial electrodes. W…
WatchHand: Enabling Continuous Hand Pose Tracking On Off-the-Shelf Smartwatches
Jiwan Kim, Chi-Jung Lee, Hohurn Jung +4
Tracking hand poses on wrist-wearables enables rich, expressive interactions, yet remains unavailable on commercial smartwatches, as prior implementations rely on external sensors…
"Why the face?": Exploring Robot Error Detection Using Instrumented Bystander Reactions
Maria Teresa Parreira, Ruidong Zhang, Sukruth Gowdru Lingaraju +7
How do humans recognize and rectify social missteps? We achieve social competence by looking around at our peers, decoding subtle cues from bystanders - a raised eyebrow, a laugh -…
Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand
Chi-Jung Lee, Jiaxin Li, Tianhong Catherine Yu +4
As computing devices become increasingly integrated into daily life, there is a growing need for intuitive, always-available interaction methods, even when users' hands are occupie…
SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking
Tianhong Catherine Yu, Manru Mary Zhang, Peter He +6
Seams are areas of overlapping fabric formed by stitching two or more pieces of fabric together in the cut-and-sew apparel manufacturing process. In SeamPose, we repurposed seams a…
SonicID: User Identification on Smart Glasses with Acoustic Sensing
Ke Li, Devansh Agarwal, Ruidong Zhang +6
Smart glasses have become more prevalent as they provide an increasing number of applications for users. They store various types of private information or can access it via connec…
ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Wave Around the Body
Saif Mahmud, Vineet Parikh, Qikang Liang +7
We present ActSonic, an intelligent, low-power active acoustic sensing system integrated into eyeglasses that can recognize 27 different everyday activities (e.g., eating, drinking…
Ring-a-Pose: A Ring for Continuous Hand Pose Tracking
Tianhong Catherine Yu, Guilin Hu, Ruidong Zhang +9
We present Ring-a-Pose, a single untethered ring that tracks continuous 3D hand poses. Located in the center of the hand, the ring emits an inaudible acoustic signal that each hand…
GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame
Ke Li, Ruidong Zhang, Boao Chen +6
In this paper, we present GazeTrak, the first acoustic-based eye tracking system on glasses. Our system only needs one speaker and four microphones attached to each side of the gla…
EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses
Ke Li, Ruidong Zhang, Siyuan Chen +4
In this paper, we introduce EyeEcho, a minimally-obtrusive acoustic sensing system designed to enable glasses to continuously monitor facial expressions. It utilizes two pairs of s…
EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband
Chi-Jung Lee, Ruidong Zhang, Devansh Agarwal +10
Our hands serve as a fundamental means of interaction with the world around us. Therefore, understanding hand poses and interaction context is critical for human-computer interacti…