5 papers · 1 filter
Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Input
Jian Wang, Rishabh Dabral, Diogo Luvizon +4
This work focuses on tracking and understanding human motion using consumer wearable devices, such as VR/AR headsets, smart glasses, cellphones, and smartwatches. These devices pro…
FRAME: Floor-aligned Representation for Avatar Motion from Egocentric Video
Andrea Boscolo Camiletto, Jian Wang, Eduardo Alvarado +4
Egocentric motion capture with a head-mounted body-facing stereo camera is crucial for VR and AR applications but presents significant challenges such as heavy occlusions and limit…
Bring Your Rear Cameras for Egocentric 3D Human Pose Estimation
Hiroyasu Akada, Jian Wang, Vladislav Golyanik +1
Egocentric 3D human pose estimation has been actively studied using cameras installed in front of a head-mounted device (HMD). While frontal placement is the optimal and the only o…
EventEgo3D++: 3D Human Motion Capture from a Head-Mounted Event Camera
Christen Millerdurai, Hiroyasu Akada, Jian Wang +5
Monocular egocentric 3D human motion capture remains a significant challenge, particularly under conditions of low lighting and fast movements, which are common in head-mounted dev…
EgoAvatar: Egocentric View-Driven and Photorealistic Full-body Avatars
Jianchun Chen, Jian Wang, Yinda Zhang +4
Immersive VR telepresence ideally means being able to interact and communicate with digital avatars that are indistinguishable from and precisely reflect the behaviour of their rea…