3 citations · 8 across the 13 of their papers we have counts for
13 papers
Physics-based Human Pose Estimation from a Single Moving RGB Camera
Ayce Idil Aytekin, Chuqiao Li, Diogo Luvizon +4
Most monocular and physics-based human pose tracking methods, while achieving state-of-the-art results, suffer from artifacts when the scene does not have a strictly flat ground pl…
Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Input
Jian Wang, Rishabh Dabral, Diogo Luvizon +4
This work focuses on tracking and understanding human motion using consumer wearable devices, such as VR/AR headsets, smart glasses, cellphones, and smartwatches. These devices pro…
EventEgo3D++: 3D Human Motion Capture from a Head-Mounted Event Camera
Christen Millerdurai, Hiroyasu Akada, Jian Wang +5
Monocular egocentric 3D human motion capture remains a significant challenge, particularly under conditions of low lighting and fast movements, which are common in head-mounted dev…
PocoLoco: A Point Cloud Diffusion Model of Human Shape in Loose Clothing
Siddharth Seth, Rishabh Dabral, Diogo Luvizon +4
Modeling a human avatar that can plausibly deform to articulations is an active area of research. We present PocoLoco -- the first template-free, point-based, pose-conditioned gene…
EventEgo3D: 3D Human Motion Capture from Egocentric Event Streams
Christen Millerdurai, Hiroyasu Akada, Jian Wang +3
Monocular egocentric 3D human motion capture is a challenging and actively researched problem. Existing methods use synchronously operating visual sensors (e.g. RGB cameras) and of…
3D Pose Estimation of Two Interacting Hands from a Monocular Event Camera
Christen Millerdurai, Diogo Luvizon, Viktor Rudnev +4
3D hand tracking from a monocular video is a very challenging problem due to hand interactions, occlusions, left-right hand ambiguity, and fast motion. Most existing methods rely o…
Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement
Jian Wang, Zhe Cao, Diogo Luvizon +5
In this work, we explore egocentric whole-body motion capture using a single fisheye camera, which simultaneously estimates human body and hand motion. This task presents significa…
Relightable Neural Actor with Intrinsic Decomposition and Pose Control
Diogo Luvizon, Vladislav Golyanik, Adam Kortylewski +2
Creating a controllable and relightable digital avatar from multi-view video with fixed illumination is a very challenging problem since humans are highly articulated, creating pos…
Holoported Characters: Real-time Free-viewpoint Rendering of Humans from Sparse RGB Cameras
Ashwath Shetty, Marc Habermann, Guoxing Sun +3
We present the first approach to render highly realistic free-viewpoint videos of a human actor in general apparel, from sparse multi-view recording to display, in real-time at an…
Scene-Aware 3D Multi-Human Motion Capture from a Single Camera
Diogo Luvizon, Marc Habermann, Vladislav Golyanik +2
In this work, we consider the problem of estimating the 3D position of multiple humans in a scene as well as their body shape and articulation from a single RGB video recorded with…
Scene-aware Egocentric 3D Human Pose Estimation
Jian Wang, Lingjie Liu, Weipeng Xu +3
Egocentric 3D human pose estimation with a single head-mounted fisheye camera has recently attracted attention due to its numerous applications in virtual and augmented reality. Ex…
HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand Reconstruction with Normalizing Flow
Jiayi Wang, Diogo Luvizon, Franziska Mueller +4
Reconstructing two-hand interactions from a single image is a challenging problem due to ambiguities that stem from projective geometry and heavy occlusions. Existing methods are d…
Estimating Egocentric 3D Human Pose in the Wild with External Weak Supervision
Jian Wang, Lingjie Liu, Weipeng Xu +3
Egocentric 3D human pose estimation with a single fisheye camera has drawn a significant amount of attention recently. However, existing methods struggle with pose estimation from…