4 papers
MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry
Yiquan Li, Taeyoung Yeon, Chenfeng Gao +3
Inertial odometry (IO) using only Inertial Measurement Units (IMUs) provides a lightweight solution for human motion tracking in augmented reality (AR) and wearable devices. Recent…
SurfaceXR: Fusing Smartwatch IMUs and Egocentric Hand Pose for Seamless Surface Interactions
Vasco Xu, Brian Chen, Eric J. Gonzalez +4
Mid-air gestures in Extended Reality (XR) often cause fatigue and imprecision. Surface-based interactions offer improved accuracy and comfort, but current egocentric vision methods…
WatchHAR: Real-time On-device Human Activity Recognition System for Smartwatches
Taeyoung Yeon, Vasco Xu, Henry Hoffmann +1
Despite advances in practical and multimodal fine-grained Human Activity Recognition (HAR), a system that runs entirely on smartwatches in unconstrained environments remains elusiv…
MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices
Vasco Xu, Chenfeng Gao, Henry Hoffmann +1
There has been a continued trend towards minimizing instrumentation for full-body motion capture, going from specialized rooms and equipment, to arrays of worn sensors and recently…