182 citations · 548 across the 24 of their papers we have counts for
24 papers
Relighting Neural Radiance Fields with Shadow and Highlight Hints
Chong Zeng, Guojun Chen, Yue Dong +3
This paper presents a novel neural implicit radiance representation for free viewpoint relighting from a small set of unstructured photographs of an object lit by a moving point li…
Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objects
Ziyu Wang, Yu Deng, Jiaolong Yang +2
3D-aware generative models have demonstrated their superb performance to generate 3D neural radiance fields (NeRF) from a collection of monocular 2D images even for topology-varyin…
Sparse Ellipsometry: Portable Acquisition of Polarimetric SVBRDF and Shape with Unstructured Flash Photography
Inseung Hwang, Daniel S. Jeon, Adolfo Muñoz +3
Ellipsometry techniques allow to measure polarization information of materials, requiring precise rotations of optical components with different configurations of lights and sensor…
GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifolds
Jianfeng Xiang, Jiaolong Yang, Yu Deng +1
Recent works have shown that 3D-aware GANs trained on unstructured single image collections can generate multiview images of novel instances. The key underpinnings to achieve this…
VirtualCube: An Immersive 3D Video Communication System
Yizhong Zhang, Jiaolong Yang, Zhen Liu +4
The VirtualCube system is a 3D video conference system that attempts to overcome some limitations of conventional technologies. The key ingredient is VirtualCube, an abstract repre…
GRAM: Generative Radiance Manifolds for 3D-Aware Image Generation
Yu Deng, Jiaolong Yang, Jianfeng Xiang +1
3D-aware image generative modeling aims to generate 3D-consistent images with explicitly controllable camera poses. Recent works have shown promising results by training neural rad…
StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation
Wonjong Jang, Gwangjin Ju, Yucheol Jung +3
We present a caricature generation framework based on shape and style manipulation using StyleGAN. Our framework, dubbed StyleCariGAN, automatically creates a realistic and detaile…
High-Resolution Optical Flow from 1D Attention and Correlation
Haofei Xu, Jiaolong Yang, Jianfei Cai +2
Optical flow is inherently a 2D search problem, and thus the computational complexity grows quadratically with respect to the search window, making large displacements matching inf…
Learning and Exploring Motor Skills with Spacetime Bounds
Li-Ke Ma, Zeshi Yang, Xin Tong +2
Equipping characters with diverse motor skills is the current bottleneck of physics-based character animation. We propose a Deep Reinforcement Learning (DRL) framework that enables…
Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondence
Yu Deng, Jiaolong Yang, Xin Tong
We propose a novel Deformed Implicit Field (DIF) representation for modeling 3D shapes of a category and generating dense correspondences among shapes. With DIF, a 3D shape is repr…
Object-based Illumination Estimation with Rendering-aware Neural Networks
Xin Wei, Guojun Chen, Yue Dong +2
We present a scheme for fast environment light estimation from the RGBD appearance of individual objects and their local image areas. Conventional inverse rendering is too computat…
SkeletonNet: A Topology-Preserving Solution for Learning Mesh Reconstruction of Object Surfaces from RGB Images
Jiapeng Tang, Xiaoguang Han, Mingkui Tan +2
This paper focuses on the challenging task of learning 3D object surface reconstructions from RGB images. Existingmethods achieve varying degrees of success by using different surf…
Deep Octree-based CNNs with Output-Guided Skip Connections for 3D Shape and Scene Completion
Peng-Shuai Wang, Yang Liu, Xin Tong
Acquiring complete and clean 3D shape and scene data is challenging due to geometric occlusion and insufficient views during 3D capturing. We present a simple yet effective deep le…
Deep 3D Portrait from a Single Image
Sicheng Xu, Jiaolong Yang, Dong Chen +4
In this paper, we present a learning-based approach for recovering the 3D geometry of human head from a single portrait image. Our method is learned in an unsupervised manner witho…
Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning
Yu Deng, Jiaolong Yang, Dong Chen +2
We propose DiscoFaceGAN, an approach for face image generation of virtual people with disentangled, precisely-controllable latent representations for identity of non-existing peopl…
Synthesizing 3D Shapes from Silhouette Image Collections using Multi-projection Generative Adversarial Networks
Xiao Li, Yue Dong, Pieter Peers +1
We present a new weakly supervised learning-based method for generating novel category-specific 3D shapes from unoccluded image collections. Our method is weakly supervised and onl…
A Skeleton-bridged Deep Learning Approach for Generating Meshes of Complex Topologies from Single RGB Images
Jiapeng Tang, Xiaoguang Han, Junyi Pan +2
This paper focuses on the challenging task of learning 3D object surface reconstructions from single RGB images. Existing methods achieve varying degrees of success by using differ…
Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Set
Yu Deng, Jiaolong Yang, Sicheng Xu +3
Recently, deep learning based 3D face reconstruction methods have shown promising results in both quality and efficiency.However, training deep neural networks typically requires a…
Image Smoothing via Unsupervised Learning
Qingnan Fan, Jiaolong Yang, David Wipf +2
Image smoothing represents a fundamental component of many disparate computer vision and graphics applications. In this paper, we present a unified unsupervised (label-free) learni…
Deep Single-View 3D Object Reconstruction with Visual Hull Embedding
Hanqing Wang, Jiaolong Yang, Wei Liang +1
3D object reconstruction is a fundamental task of many robotics and AI problems. With the aid of deep convolutional neural networks (CNNs), 3D object reconstruction has witnessed a…
Modeling Surface Appearance from a Single Photograph using Self-augmented Convolutional Neural Networks
Xiao Li, Yue Dong, Pieter Peers +1
We present a convolutional neural network (CNN) based solution for modeling physically plausible spatially varying surface reflectance functions (SVBRDF) from a single photograph o…
HairNet: Single-View Hair Reconstruction using Convolutional Neural Networks
Yi Zhou, Liwen Hu, Jun Xing +4
We introduce a deep learning-based method to generate full 3D hair geometry from an unconstrained image. Our method can recover local strand details and has real-time performance.…
View-volume Network for Semantic Scene Completion from a Single Depth Image
Yu-Xiao Guo, Xin Tong
We introduce a View-Volume convolutional neural network (VVNet) for inferring the occupancy and semantic labels of a volumetric 3D scene from a single depth image. The VVNet concat…
DeepToF: Off-the-Shelf Real-Time Correction of Multipath Interference in Time-of-Flight Imaging
Julio Marco, Quercus Hernandez, Adolfo Muñoz +5
Time-of-flight (ToF) imaging has become a widespread technique for depth estimation, allowing affordable off-the-shelf cameras to provide depth maps in real time. However, multipat…