7 papers · 1 filter
Physics-based Human Pose Estimation from a Single Moving RGB Camera
Ayce Idil Aytekin, Chuqiao Li, Diogo Luvizon +4
Most monocular and physics-based human pose tracking methods, while achieving state-of-the-art results, suffer from artifacts when the scene does not have a strictly flat ground pl…
Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Input
Jian Wang, Rishabh Dabral, Diogo Luvizon +4
This work focuses on tracking and understanding human motion using consumer wearable devices, such as VR/AR headsets, smart glasses, cellphones, and smartwatches. These devices pro…
EventEgo3D++: 3D Human Motion Capture from a Head-Mounted Event Camera
Christen Millerdurai, Hiroyasu Akada, Jian Wang +5
Monocular egocentric 3D human motion capture remains a significant challenge, particularly under conditions of low lighting and fast movements, which are common in head-mounted dev…
PocoLoco: A Point Cloud Diffusion Model of Human Shape in Loose Clothing
Siddharth Seth, Rishabh Dabral, Diogo Luvizon +4
Modeling a human avatar that can plausibly deform to articulations is an active area of research. We present PocoLoco -- the first template-free, point-based, pose-conditioned gene…
Relightable Neural Actor with Intrinsic Decomposition and Pose Control
Diogo Luvizon, Vladislav Golyanik, Adam Kortylewski +2
Creating a controllable and relightable digital avatar from multi-view video with fixed illumination is a very challenging problem since humans are highly articulated, creating pos…
Holoported Characters: Real-time Free-viewpoint Rendering of Humans from Sparse RGB Cameras
Ashwath Shetty, Marc Habermann, Guoxing Sun +3
We present the first approach to render highly realistic free-viewpoint videos of a human actor in general apparel, from sparse multi-view recording to display, in real-time at an…