50 citations · 150 across the 22 of their papers we have counts for
23 papers
A Review of Behavioral Closed-Loop Paradigm from Sensing to Intervention for Ingestion Health
Jun Fang, Yanuo Zhou, Ka I Chan +8
Ingestive behavior plays a critical role in health, yet many existing interventions remain limited to static guidance or manual self-tracking. With the increasing integration of se…
Memory-efficient Low-latency Remote Photoplethysmography through Temporal-Spatial State Space Duality
Kegang Wang, Jiankai Tang, Yuxuan Fan +3
Remote photoplethysmography (rPPG), enabling non-contact physiological monitoring through facial light reflection analysis, faces critical computational bottlenecks as deep learnin…
Camera Measurement of Blood Oxygen Saturation
Jiankai Tang, Xin Liu, Daniel McDuff +11
Blood oxygen saturation (SpO2) is a crucial vital sign routinely monitored in medical settings. Traditional methods require dedicated contact sensors, limiting accessibility and co…
Unknown Word Detection for English as a Second Language (ESL) Learners Using Gaze and Pre-trained Language Models
Jiexin Ding, Bowen Zhao, Yuntao Wang +4
English as a Second Language (ESL) learners often encounter unknown words that hinder their text comprehension. Automatically detecting these words as users read can enable computi…
Modeling the Impact of Visual Stimuli on Redirection Noticeability with Gaze Behavior in Virtual Reality
Zhipeng Li, Yishu Ji, Ruijia Chen +4
While users could embody virtual avatars that mirror their physical movements in Virtual Reality, these avatars' motions can be redirected to enable novel interactions. Excessive r…
Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes
Ke Liu, Jiankai Tang, Zhang Jiang +4
Video photoplethysmography (vPPG) is an emerging method for non-invasive and convenient measurement of physiological signals, utilizing two primary approaches: remote video PPG (rP…
SonarWatch: Field sensing technique for smartwatches based on ultrasound and motion
Yingtian Shi, Chun Yu, Xuyang Lu +3
A smartwatch worn continuously on the wrist has the potential to perceive rich interactive gestures and natural behaviors of the user. Unfortunately, the current interaction functi…
The Odyssey Journey: Top-Tier Medical Resource Seeking for Specialized Disorder in China
Ka I Chan, Siying Hu, Yuntao Wang +3
It is pivotal for patients to receive accurate health information, diagnoses, and timely treatments. However, in China, the significant imbalanced doctor-to-patient ratio intensifi…
G-VOILA: Gaze-Facilitated Information Querying in Daily Scenarios
Zeyu Wang, Yuanchun Shi, Yuntao Wang +6
Modern information querying systems are progressively incorporating multimodal inputs like vision and audio. However, the integration of gaze -- a modality deeply linked to user in…
Time2Stop: Adaptive and Explainable Human-AI Loop for Smartphone Overuse Intervention
Adiba Orzikulova, Han Xiao, Zhipeng Li +7
Despite a rich history of investigating smartphone overuse intervention techniques, AI-based just-in-time adaptive intervention (JITAI) methods for overuse reduction are lacking. W…
Leveraging Large Language Models for Generating Mobile Sensing Strategies in Human Behavior Modeling
Nan Gao, Zhuolei Yu, Yue Xu +4
Mobile sensing plays a crucial role in generating digital traces to understand human daily lives. However, studying behaviours like mood or sleep quality in smartphone users requir…
MindShift: Leveraging Large Language Models for Mental-States-Based Problematic Smartphone Use Intervention
Ruolan Wu, Chun Yu, Xiaole Pan +9
Problematic smartphone use negatively affects physical and mental health. Despite the wide range of prior research, existing persuasive techniques are not flexible enough to provid…
UbiPhysio: Support Daily Functioning, Fitness, and Rehabilitation with Action Understanding and Feedback in Natural Language
Chongyang Wang, Yuan Feng, Lingxiao Zhong +8
We introduce UbiPhysio, a milestone framework that delivers fine-grained action description and feedback in natural language to support people's daily functioning, fitness, and reh…
EarCough: Enabling Continuous Subject Cough Event Detection on Hearables
Xiyuxing Zhang, Yuntao Wang, Jingru Zhang +3
Cough monitoring can enable new individual pulmonary health applications. Subject cough event detection is the foundation for continuous cough monitoring. Recently, the rapid growt…
GazeReader: Detecting Unknown Word Using Webcam for English as a Second Language (ESL) Learners
Jiexin Ding, Bowen Zhao, Yuqi Huang +2
Automatic unknown word detection techniques can enable new applications for assisting English as a Second Language (ESL) learners, thus improving their reading experiences. However…
Enabling Voice-Accompanying Hand-to-Face Gesture Recognition with Cross-Device Sensing
Zisu Li, Cheng Liang, Yuntao Wang +5
Gestures performed accompanying the voice are essential for voice interaction to convey complementary semantics for interaction purposes such as wake-up state and input modality. I…
Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Images
Yuntao Wang, Zirui Cheng, Xin Yi +7
A computer vision system using low-resolution image sensors can provide intelligent services (e.g., activity recognition) but preserve unnecessary visual privacy information from t…
MMPD: Multi-Domain Mobile Video Physiology Dataset
Jiankai Tang, Kequan Chen, Yuntao Wang +4
Remote photoplethysmography (rPPG) is an attractive method for noninvasive, convenient and concomitant measurement of physiological vital signals. Public benchmark datasets have se…
Facilitating Self-monitored Physical Rehabilitation with Virtual Reality and Haptic feedback
Yu Jiang, Zhipeng Li, Ziyue Dang +8
Physical rehabilitation is essential to recovery from joint replacement operations. As a representation, total knee arthroplasty (TKA) requires patients to conduct intensive physic…
MMTSA: Multimodal Temporal Segment Attention Network for Efficient Human Activity Recognition
Ziqi Gao, Yuntao Wang, Jianguo Chen +4
Multimodal sensors provide complementary information to develop accurate machine-learning methods for human activity recognition (HAR), but introduce significantly higher computati…
Modeling the Noticeability of User-Avatar Movement Inconsistency for Sense of Body Ownership Intervention
Zhipeng Li, Yu Jiang, Yihao Zhu +5
An avatar mirroring the user's movement is commonly adopted in Virtual Reality(VR). Maintaining the user-avatar movement consistency provides the user a sense of body ownership and…
FaceOri: Tracking Head Position and Orientation Using Ultrasonic Ranging on Earphones
Yuntao Wang, Jiexin Ding, Ishan Chatterjee +5
Face orientation can often indicate users' intended interaction target. In this paper, we propose FaceOri, a novel face tracking technique based on acoustic ranging using earphones…
Enabling Real-time On-chip Audio Super Resolution for Bone Conduction Microphones
Yuang Li, Yuntao Wang, Xin Liu +2
Voice communication using the air conduction microphone in noisy environments suffers from the degradation of speech audibility. Bone conduction microphones (BCM) are robust agains…