43 citations · 134 across the 14 of their papers we have counts for
15 papers
DITTO: Dexterous Interface for Transparent TeleOperation
Joaquin Palacios, Katelyn Lee, Cheng Zhang +2
Collecting data for manipulation with high-DOF hands is challenging, as interfaces must capture rich hand motion while rendering the contact interactions essential for precise mani…
WatchHand: Enabling Continuous Hand Pose Tracking On Off-the-Shelf Smartwatches
Jiwan Kim, Chi-Jung Lee, Hohurn Jung +4
Tracking hand poses on wrist-wearables enables rich, expressive interactions, yet remains unavailable on commercial smartwatches, as prior implementations rely on external sensors…
"Why the face?": Exploring Robot Error Detection Using Instrumented Bystander Reactions
Maria Teresa Parreira, Ruidong Zhang, Sukruth Gowdru Lingaraju +7
How do humans recognize and rectify social missteps? We achieve social competence by looking around at our peers, decoding subtle cues from bystanders - a raised eyebrow, a laugh -…
MiniBEE: A New Form Factor for Compact Bimanual Dexterity
Sharfin Islam, Zewen Chen, Zhanpeng He +8
Bimanual robot manipulators can achieve impressive dexterity, but typically rely on two full six- or seven- degree-of-freedom arms so that paired grippers can coordinate effectivel…
Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand
Chi-Jung Lee, Jiaxin Li, Tianhong Catherine Yu +4
As computing devices become increasingly integrated into daily life, there is a growing need for intuitive, always-available interaction methods, even when users' hands are occupie…
WristSonic: Enabling Fine-grained Hand-Face Interactions on Smartwatches Using Active Acoustic Sensing
Saif Mahmud, Kian Mahmoodi, Chi-Jung Lee +2
Hand-face interactions play a key role in many everyday tasks, providing insights into user habits, behaviors, intentions, and expressions. However, existing wearable sensing syste…
EchoGuide: Active Acoustic Guidance for LLM-Based Eating Event Analysis from Egocentric Videos
Vineet Parikh, Saif Mahmud, Devansh Agarwal +3
Self-recording eating behaviors is a step towards a healthy lifestyle recommended by many health professionals. However, the current practice of manually recording eating activitie…
SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking
Tianhong Catherine Yu, Manru Mary Zhang, Peter He +6
Seams are areas of overlapping fabric formed by stitching two or more pieces of fabric together in the cut-and-sew apparel manufacturing process. In SeamPose, we repurposed seams a…
SonicID: User Identification on Smart Glasses with Acoustic Sensing
Ke Li, Devansh Agarwal, Ruidong Zhang +6
Smart glasses have become more prevalent as they provide an increasing number of applications for users. They store various types of private information or can access it via connec…
MunchSonic: Tracking Fine-grained Dietary Actions through Active Acoustic Sensing on Eyeglasses
Saif Mahmud, Devansh Agarwal, Ashwin Ajit +4
We introduce MunchSonic, an AI-powered active acoustic sensing system integrated into eyeglasses to track fine-grained dietary actions. MunchSonic emits inaudible ultrasonic waves…
ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Wave Around the Body
Saif Mahmud, Vineet Parikh, Qikang Liang +7
We present ActSonic, an intelligent, low-power active acoustic sensing system integrated into eyeglasses that can recognize 27 different everyday activities (e.g., eating, drinking…
Ring-a-Pose: A Ring for Continuous Hand Pose Tracking
Tianhong Catherine Yu, Guilin Hu, Ruidong Zhang +9
We present Ring-a-Pose, a single untethered ring that tracks continuous 3D hand poses. Located in the center of the hand, the ring emits an inaudible acoustic signal that each hand…
GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame
Ke Li, Ruidong Zhang, Boao Chen +6
In this paper, we present GazeTrak, the first acoustic-based eye tracking system on glasses. Our system only needs one speaker and four microphones attached to each side of the gla…
EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses
Ke Li, Ruidong Zhang, Siyuan Chen +4
In this paper, we introduce EyeEcho, a minimally-obtrusive acoustic sensing system designed to enable glasses to continuously monitor facial expressions. It utilizes two pairs of s…
EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband
Chi-Jung Lee, Ruidong Zhang, Devansh Agarwal +10
Our hands serve as a fundamental means of interaction with the world around us. Therefore, understanding hand poses and interaction context is critical for human-computer interacti…