6 papers
Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Camera
Jae Shin Yoon, Kihwan Kim, Orazio Gallo +2
This paper presents a new method to synthesize an image from arbitrary views and times given a collection of images of a dynamic scene. A key challenge for the novel view synthesis…
Self-Supervised Adaptation of High-Fidelity Face Models for Monocular Performance Tracking
Jae Shin Yoon, Takaaki Shiratori, Shoou-I Yu +1
Improvements in data-capture and face modeling techniques have enabled us to create high-fidelity realistic face models. However, driving these realistic face models requires speci…
Multiview Cross-supervision for Semantic Segmentation
Yuan Yao, Hyun Soo Park
This paper presents a semi-supervised learning framework for a customized semantic segmentation task using multiview image streams. A key challenge of the customized task lies in t…
ECO: Egocentric Cognitive Mapping
Jayant Sharma, Zixing Wang, Alberto Speranzon +2
We present a new method to localize a camera within a previously unseen environment perceived from an egocentric point of view. Although this is, in general, an ill-posed problem,…
HUMBI: A Large Multiview Dataset of Human Body Expressions
Zhixuan Yu, Jae Shin Yoon, In Kyu Lee +4
This paper presents a new large multiview dataset called HUMBI for human body expressions with natural clothing. The goal of HUMBI is to facilitate modeling view-specific appearanc…
3D Semantic Trajectory Reconstruction from 3D Pixel Continuum
Jae Shin Yoon, Ziwei Li, Hyun Soo Park
This paper presents a method to reconstruct dense semantic trajectory stream of human interactions in 3D from synchronized multiple videos. The interactions inherently introduce se…