activity
20202025
most citedMulti-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement

150 citations · 362 across the 18 of their papers we have counts for

collaborators

19 papers

cs.CV2025

Estimating Blood Pressure with a Camera: An Exploratory Study of Ambulatory Patients with Cardiovascular Disease

Theodore Curran, Chengqian Ma, Xin Liu +5

Hypertension is a leading cause of morbidity and mortality worldwide. The ability to diagnose and treat hypertension in the ambulatory population is hindered by limited access and…

cs.AI2023★ 48 cited

From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models

Zachary Englhardt, Chengqian Ma, Margaret E. Morris +7

Passively collected behavioral health data from ubiquitous sensors holds significant promise to provide mental health professionals insights from patient's daily lives; however, de…

cs.CV2023★ 1 cited

rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurement

Xin Liu, Yuting Zhang, Zitong Yu +3

Remote photoplethysmography (rPPG) is an important technique for perceiving human vital signs, which has received extensive attention. For a long time, researchers have focused on…

cs.CL2023★ 36 cited

Large Language Models are Few-Shot Health Learners

Xin Liu, Daniel McDuff, Geza Kovacs +7

Large language models (LLMs) can capture rich representations of concepts that are useful for real-world tasks. However, language alone is limited. While existing LLMs excel at tex…

cs.CV2023

Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurement

Akshay Paruchuri, Xin Liu, Yulu Pan +3

Machine learning models for camera-based physiological measurement can have weak generalization due to a lack of representative training data. Body motion is one of the most signif…

cs.CV2023★ 3 cited

BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurements

Girish Narayanswamy, Yujia Liu, Yuzhe Yang +4

Understanding of human visual perception has historically inspired the design of computer vision architectures. As an example, perception occurs at different scales both spatially…

cs.CV2023★ 1 cited

MMPD: Multi-Domain Mobile Video Physiology Dataset

Jiankai Tang, Kequan Chen, Yuntao Wang +4

Remote photoplethysmography (rPPG) is an attractive method for noninvasive, convenient and concomitant measurement of physiological vital signals. Public benchmark datasets have se…

cs.LG2022★ 20 cited

SimPer: Simple Self-Supervised Learning of Periodic Targets

Yuzhe Yang, Xin Liu, Jiang Wu +4

From human physiology to environmental evolution, important processes in nature often exhibit meaningful and strong periodic or quasi-periodic changes. Due to their inherent label…

cs.CV2022★ 21 cited

rPPG-Toolbox: Deep Remote PPG Toolbox

Xin Liu, Girish Narayanswamy, Akshay Paruchuri +7

Camera-based physiological measurement is a fast growing field of computer vision. Remote photoplethysmography (rPPG) utilizes imaging devices (e.g., cameras) to measure the periph…

cs.CV2022★ 19 cited

SCAMPS: Synthetics for Camera Measurement of Physiological Signals

Daniel McDuff, Miah Wander, Xin Liu +4

The use of cameras and computational algorithms for noninvasive, low-cost and scalable measurement of physiological (e.g., cardiac and pulmonary) vital signs is very attractive. Ho…

cs.CV2022★ 20 cited

MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensing

Xin Liu, Yuntao Wang, Sinan Xie +4

Camera-based contactless photoplethysmography refers to a set of popular techniques for contactless physiological measurement. The current state-of-the-art neural models are typica…

cs.SD2021

Enabling Real-time On-chip Audio Super Resolution for Bone Conduction Microphones

Yuang Li, Yuntao Wang, Xin Liu +2

Voice communication using the air conduction microphone in noisy environments suffers from the degradation of speech audibility. Bone conduction microphones (BCM) are robust agains…

cs.CV2021

Synthetic Data for Multi-Parameter Camera-Based Physiological Sensing

Daniel McDuff, Xin Liu, Javier Hernandez +2

Synthetic data is a powerful tool in training data hungry deep learning algorithms. However, to date, camera-based physiological sensing has not taken full advantage of these techn…

cs.CV2021★ 1 cited

RGB Camera-based Physiological Sensing: Challenges and Future Directions

Xin Liu, Shwetak Patel, Daniel McDuff

Numerous real-world applications have been driven by the recent algorithmic advancement of artificial intelligence (AI). Healthcare is no exception and AI technologies have great p…

cs.CV2021★ 14 cited

EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurement

Xin Liu, Brian L. Hill, Ziheng Jiang +2

Camera-based physiological measurement is a growing field with neural models providing state-the-art-performance. Prior research have explored various "end-to-end" models; however…

eess.IV2021★ 1 cited

Learning Higher-Order Dynamics in Video-Based Cardiac Measurement

Brian L. Hill, Xin Liu, Daniel McDuff

Computer vision methods typically optimize for first-order dynamics (e.g., optical flow). However, in many cases the properties of interest are subtle variations in higher-order ch…

cs.CV2020★ 16 cited

Advancing Non-Contact Vital Sign Measurement using Synthetic Avatars

Daniel McDuff, Javier Hernandez, Erroll Wood +2

Non-contact physiological measurement has the potential to provide low-cost, non-invasive health monitoring. However, machine vision approaches are often limited by the availabilit…

cs.CV2020★ 11 cited

MetaPhys: Few-Shot Adaptation for Non-Contact Physiological Measurement

Xin Liu, Ziheng Jiang, Josh Fromm +3

There are large individual differences in physiological processes, making designing personalized health sensing algorithms challenging. Existing machine learning systems struggle t…

eess.SP2020★ 150 cited

Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement

Xin Liu, Josh Fromm, Shwetak Patel +1

Telehealth and remote health monitoring have become increasingly important during the SARS-CoV-2 pandemic and it is widely expected that this will have a lasting impact on healthca…