43 citations · 146 across the 15 of their papers we have counts for
16 papers
Synthesizing Ultrasonic Echo Profiles from Text for Open-Vocabulary Silent Speech Recognition
Jiacheng Liu, Ruidong Zhang, François Guimbretière +1
Eyewear that senses articulation with inaudible ultrasound can now recognize silent speech over an open vocabulary, but its accuracy is limited by the cost of training data. We pre…
SoniSpeech: A Large-Scale Open-Vocabulary Tri-Modal Dataset for Wearable Silent Speech Interfaces
Ruidong Zhang, Jiacheng Liu, François Guimbretière +1
Wearable silent speech interfaces (SSIs) are limited to small, closed vocabularies. Approaches achieving larger vocabularies require obtrusive hardware such as facial electrodes. W…
Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand
Chi-Jung Lee, Jiaxin Li, Tianhong Catherine Yu +4
As computing devices become increasingly integrated into daily life, there is a growing need for intuitive, always-available interaction methods, even when users' hands are occupie…
SpellRing: Recognizing Continuous Fingerspelling in American Sign Language using a Ring
Hyunchul Lim, Nam Anh Dang, Dylan Lee +8
Fingerspelling is a critical part of American Sign Language (ASL) recognition and has become an accessible optional text entry method for Deaf and Hard of Hearing (DHH) individuals…
OriStitch: A Machine Embroidery Workflow to Turn Existing Fabrics into Self-Folding 3D Textiles
Zekun Chang, Yixuan Gao, Yuta Noma +11
OriStitch is a computational fabrication workflow to turn existing flat fabrics into self-folding 3D structures. Users turn fabrics into self-folding sheets by machine embroidering…
WristSonic: Enabling Fine-grained Hand-Face Interactions on Smartwatches Using Active Acoustic Sensing
Saif Mahmud, Kian Mahmoodi, Chi-Jung Lee +2
Hand-face interactions play a key role in many everyday tasks, providing insights into user habits, behaviors, intentions, and expressions. However, existing wearable sensing syste…
SplatOverflow: Asynchronous Hardware Troubleshooting
Amritansh Kwatra, Tobias Weinberg, Ilan Mandel +4
As tools for designing and manufacturing hardware become more accessible, smaller producers can develop and distribute novel hardware. However, processes for supporting end-user ha…
EchoGuide: Active Acoustic Guidance for LLM-Based Eating Event Analysis from Egocentric Videos
Vineet Parikh, Saif Mahmud, Devansh Agarwal +3
Self-recording eating behaviors is a step towards a healthy lifestyle recommended by many health professionals. However, the current practice of manually recording eating activitie…
SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking
Tianhong Catherine Yu, Manru Mary Zhang, Peter He +6
Seams are areas of overlapping fabric formed by stitching two or more pieces of fabric together in the cut-and-sew apparel manufacturing process. In SeamPose, we repurposed seams a…
SonicID: User Identification on Smart Glasses with Acoustic Sensing
Ke Li, Devansh Agarwal, Ruidong Zhang +6
Smart glasses have become more prevalent as they provide an increasing number of applications for users. They store various types of private information or can access it via connec…
MunchSonic: Tracking Fine-grained Dietary Actions through Active Acoustic Sensing on Eyeglasses
Saif Mahmud, Devansh Agarwal, Ashwin Ajit +4
We introduce MunchSonic, an AI-powered active acoustic sensing system integrated into eyeglasses to track fine-grained dietary actions. MunchSonic emits inaudible ultrasonic waves…
ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Wave Around the Body
Saif Mahmud, Vineet Parikh, Qikang Liang +7
We present ActSonic, an intelligent, low-power active acoustic sensing system integrated into eyeglasses that can recognize 27 different everyday activities (e.g., eating, drinking…
Ring-a-Pose: A Ring for Continuous Hand Pose Tracking
Tianhong Catherine Yu, Guilin Hu, Ruidong Zhang +9
We present Ring-a-Pose, a single untethered ring that tracks continuous 3D hand poses. Located in the center of the hand, the ring emits an inaudible acoustic signal that each hand…
GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame
Ke Li, Ruidong Zhang, Boao Chen +6
In this paper, we present GazeTrak, the first acoustic-based eye tracking system on glasses. Our system only needs one speaker and four microphones attached to each side of the gla…
EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses
Ke Li, Ruidong Zhang, Siyuan Chen +4
In this paper, we introduce EyeEcho, a minimally-obtrusive acoustic sensing system designed to enable glasses to continuously monitor facial expressions. It utilizes two pairs of s…
EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband
Chi-Jung Lee, Ruidong Zhang, Devansh Agarwal +10
Our hands serve as a fundamental means of interaction with the world around us. Therefore, understanding hand poses and interaction context is critical for human-computer interacti…