1.2k citations · 4.7k across the 165 of their papers we have counts for
21 papers · 1 filter
EgoCap: Egocentric Marker-less Motion Capture with Two Fisheye Cameras (Extended Abstract)
Helge Rhodin, Christian Richardt, Dan Casas +5
Marker-based and marker-less optical skeletal motion-capture methods use an outside-in arrangement of cameras placed around a scene, with viewpoints converging on the center. They…
Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervision
Dushyant Mehta, Helge Rhodin, Dan Casas +4
We propose a CNN-based approach for 3D human body pose estimation from single RGB images that addresses the issue of limited generalizability of models trained solely on the starkl…
Real-time Halfway Domain Reconstruction of Motion and Geometry
Lucas Thies, Michael Zollhöfer, Christian Richardt +2
We present a novel approach for real-time joint reconstruction of 3D scene motion and geometry from binocular stereo videos. Our approach is based on a novel variational halfway-do…
Model-based Outdoor Performance Capture
Nadia Robertini, Dan Casas, Helge Rhodin +2
We propose a new model-based method to accurately reconstruct human performances captured outdoors in a multi-camera setup. Starting from a template of the actor model, we introduc…
Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input
Srinath Sridhar, Franziska Mueller, Michael Zollhöfer +3
Real-time simultaneous tracking of hands manipulating and interacting with external objects has many potential applications in augmented reality, tangible computing, and wearable c…
Video Depth-From-Defocus
Hyeongwoo Kim, Christian Richardt, Christian Theobalt
Many compelling video post-processing effects, in particular aesthetic focus editing and refocusing effects, are feasible if per-frame depth information is available. Existing comp…
FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality
Justus Thies, Michael Zollhöfer, Marc Stamminger +2
We propose FaceVR, a novel image-based method that enables video teleconferencing in VR based on self-reenactment. State-of-the-art face tracking methods in the VR context are focu…
EgoCap: Egocentric Marker-less Motion Capture with Two Fisheye Cameras
Helge Rhodin, Christian Richardt, Dan Casas +5
Marker-based and marker-less optical skeletal motion-capture methods use an outside-in arrangement of cameras placed around a scene, with viewpoints converging on the center. They…
Dense Wide-Baseline Scene Flow From Two Handheld Video Cameras
Christian Richardt, Hyeongwoo Kim, Levi Valgaerts +1
We propose a new technique for computing dense scene flow from two handheld videos with wide camera baselines and different photometric properties due to different sensors or camer…
General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues
Helge Rhodin, Nadia Robertini, Dan Casas +3
Markerless motion capture algorithms require a 3D body with properly personalized skeleton dimension and/or body shape and appearance to successfully track a person. Unfortunately,…
Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging
Zachary DeVito, Michael Mara, Michael Zollhöfer +6
Many graphics and vision problems can be expressed as non-linear least squares optimizations of objective functions over visual data, such as images and meshes. The mathematical de…
BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integration
Angela Dai, Matthias Nießner, Michael Zollhöfer +2
Real-time, high-quality, 3D scanning of large-scale scenes is key to mixed reality and robotic applications. However, scalability brings challenges of drift in pose estimation, int…
VolumeDeform: Real-time Volumetric Non-rigid Reconstruction
Matthias Innmann, Michael Zollhöfer, Matthias Nießner +2
We present a novel approach for the reconstruction of dynamic geometric shapes using a single hand-held consumer-grade RGB-D sensor at real-time rates. Our method does not require…
Context-guided diffusion for label propagation on graphs
Kwang In Kim, James Tompkin, Hanspeter Pfister +1
Existing approaches for diffusion on graphs, e.g., for label propagation, are mainly focused on isotropic diffusion, which is induced by the commonly-used graph Laplacian regulariz…
Fast and Robust Hand Tracking Using Detection-Guided Optimization
Srinath Sridhar, Franziska Mueller, Antti Oulasvirta +1
Markerless tracking of hands and fingers is a promising enabler for human-computer interaction. However, adoption has been limited because of tracking inaccuracies, incomplete cove…
Real-Time Hand Tracking Using a Sum of Anisotropic Gaussians Model
Srinath Sridhar, Helge Rhodin, Hans-Peter Seidel +2
Real-time marker-less hand tracking is of increasing importance in human-computer interaction. Robust and accurate tracking of arbitrary hand motion is a challenging problem due to…
Semi-supervised Learning with Explicit Relationship Regularization
Kwang In Kim, James Tompkin, Hanspeter Pfister +1
In many learning tasks, the structure of the target space of a function holds rich information about the relationships between evaluations of functions on different data points. Ex…
Local High-order Regularization on Data Manifolds
Kwang In Kim, James Tompkin, Hanspeter Pfister +1
The common graph Laplacian regularizer is well-established in semi-supervised learning and spectral dimensionality reduction. However, as a first-order regularizer, it can lead to…
A Versatile Scene Model with Differentiable Visibility Applied to Generative Pose Estimation
Helge Rhodin, Nadia Robertini, Christian Richardt +2
Generative reconstruction methods compute the 3D configuration (such as pose and/or geometry) of a shape by optimizing the overlap of the projected 3D shape model with images. Prop…
Automatic Face Reenactment
Pablo Garrido, Levi Valgaerts, Ole Rehmsen +3
We propose an image-based, facial reenactment system that replaces the face of an actor in an existing target video with the face of a user from a source video, while preserving th…
Efficient Multi-view Performance Capture of Fine-Scale Surface Detail
Nadia Robertini, Edilson De Aguiar, Thomas Helten +1
We present a new effective way for performance capture of deforming meshes with fine-scale time-varying surface detail from multi-view video. Our method builds up on coarse 4D surf…