activity
20182024
most citedPhysical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors

10 citations · 12 across the 4 of their papers we have counts for

collaborators
Showing cs.CVShow all

10 papers · 1 filter

cs.CV2024

DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image

Qingxuan Wu, Zhiyang Dou, Sirui Xu +11

Reconstructing 3D hand-face interactions with deformations from a single image is a challenging yet crucial task with broad applications in AR, VR, and gaming. The challenges stem…

cs.CV2023

MACS: Mass Conditioned 3D Hand and Object Motion Synthesis

Soshi Shimada, Franziska Mueller, Jan Bednarik +7

The physical properties of an object, such as mass, significantly affect how we manipulate it with our hands. Surprisingly, this aspect has so far been neglected in prior work on 3…

cs.CV20231 cited

Decaf: Monocular Deformation Capture for Face and Hand Interactions

Soshi Shimada, Vladislav Golyanik, Patrick Pérez +1

Existing methods for 3D tracking from monocular RGB videos predominantly consider articulated and rigid objects. Modelling dense non-rigid object deformations in this setting remai…

cs.CV2021

Gravity-Aware Monocular 3D Human-Object Reconstruction

Rishabh Dabral, Soshi Shimada, Arjun Jain +2

This paper proposes GraviCap, i.e., a new approach for joint markerless 3D human motion capture and object trajectory estimation from monocular RGB videos. We focus on scenes with…

cs.CV2021

Fast Simultaneous Gravitational Alignment of Multiple Point Sets

Vladislav Golyanik, Soshi Shimada, Christian Theobalt

The problem of simultaneous rigid alignment of multiple unordered point sets which is unbiased towards any of the inputs has recently attracted increasing interest, and several rel…

cs.CV2021

Neural Monocular 3D Human Motion Capture with Physical Awareness

Soshi Shimada, Vladislav Golyanik, Weipeng Xu +2

We present a new trainable system for physically plausible markerless 3D human motion capture, which achieves state-of-the-art results in a broad range of challenging scenarios. Un…