1.2k citations · 1.5k across the 35 of their papers we have counts for
33 papers · 1 filter
Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors
Ruicheng Wang, Jianfeng Xiang, Jiaolong Yang +1
We propose a novel image editing technique that enables 3D manipulations on single images, such as object rotation and translation. Existing 3D-aware image editing approaches typic…
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars
Ronglai Zuo, Fangyun Wei, Zenggui Chen +3
The objective of this paper is to develop a functional system for translating spoken languages into sign languages, referred to as Spoken2Sign translation. The Spoken2Sign task is…
AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collections
Yue Wu, Sicheng Xu, Jianfeng Xiang +4
Previous animatable 3D-aware GANs for human generation have primarily focused on either the human head or full body. However, head-only videos are relatively uncommon in real life,…
3D-aware Image Generation using 2D Diffusion Models
Jianfeng Xiang, Jiaolong Yang, Binbin Huang +1
In this paper, we introduce a novel 3D-aware image generation method that leverages 2D diffusion models. We formulate the 3D-aware image generation task as multiview 2D image set g…
RemoteTouch: Enhancing Immersive 3D Video Communication with Hand Touch
Yizhong Zhang, Zhiqi Li, Sicheng Xu +4
Recent research advance has significantly improved the visual realism of immersive 3D video communication. In this work we present a method to further enhance this immersive experi…
FreeEnricher: Enriching Face Landmarks without Additional Cost
Yangyu Huang, Xi Chen, Jongyoo Kim +4
Recent years have witnessed significant growth of face alignment. Though dense facial landmark is highly demanded in various scenarios, e.g., cosmetic medicine and facial beautific…
NeRFInvertor: High Fidelity NeRF-GAN Inversion for Single-shot Real Image Animation
Yu Yin, Kamran Ghasedi, HsiangTao Wu +3
Nerf-based Generative models have shown impressive capacity in generating high-quality images with consistent 3D geometry. Despite successful synthesis of fake identity images rand…
AniFaceGAN: Animatable 3D-Aware Face Image Generation for Video Avatars
Yue Wu, Yu Deng, Jiaolong Yang +3
Although 2D generative models have made great progress in face image generation and animation, they often suffer from undesirable artifacts such as 3D inconsistency when rendering…
Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objects
Ziyu Wang, Yu Deng, Jiaolong Yang +2
3D-aware generative models have demonstrated their superb performance to generate 3D neural radiance fields (NeRF) from a collection of monocular 2D images even for topology-varyin…
Deep Deformable 3D Caricatures with Learned Shape Control
Yucheol Jung, Wonjong Jang, Soongjin Kim +3
A 3D caricature is an exaggerated 3D depiction of a human face. The goal of this paper is to model the variations of 3D caricatures in a compact parameter space so that we can prov…
GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifolds
Jianfeng Xiang, Jiaolong Yang, Yu Deng +1
Recent works have shown that 3D-aware GANs trained on unstructured single image collections can generate multiview images of novel instances. The key underpinnings to achieve this…
Single-View View Synthesis in the Wild with Learned Adaptive Multiplane Images
Yuxuan Han, Ruicheng Wang, Jiaolong Yang
This paper deals with the challenging task of synthesizing novel views for in-the-wild photographs. Existing methods have shown promising results leveraging monocular depth estimat…
Expanding the Latent Space of StyleGAN for Real Face Editing
Yin Yu, Ghasedi Kamran, Wu HsiangTao +3
Recently, a surge of face editing techniques have been proposed to employ the pretrained StyleGAN for semantic manipulation. To successfully edit a real image, one must first conve…
Real-Time Neural Character Rendering with Pose-Guided Multiplane Images
Hao Ouyang, Bo Zhang, Pan Zhang +5
We propose pose-guided multiplane image (MPI) synthesis which can render an animatable character in real scenes with photorealistic quality. We use a portable camera rig to capture…
MPS-NeRF: Generalizable 3D Human Rendering from Multiview Images
Xiangjun Gao, Jiaolong Yang, Jongyoo Kim +3
There has been rapid progress recently on 3D human rendering, including novel view synthesis and pose animation, based on the advances of neural radiance fields (NeRF). However, mo…
VirtualCube: An Immersive 3D Video Communication System
Yizhong Zhang, Jiaolong Yang, Zhen Liu +4
The VirtualCube system is a 3D video conference system that attempts to overcome some limitations of conventional technologies. The key ingredient is VirtualCube, an abstract repre…
GRAM: Generative Radiance Manifolds for 3D-Aware Image Generation
Yu Deng, Jiaolong Yang, Jianfeng Xiang +1
3D-aware image generative modeling aims to generate 3D-consistent images with explicitly controllable camera poses. Recent works have shown promising results by training neural rad…
StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation
Wonjong Jang, Gwangjin Ju, Yucheol Jung +3
We present a caricature generation framework based on shape and style manipulation using StyleGAN. Our framework, dubbed StyleCariGAN, automatically creates a realistic and detaile…
Disentangled Face Attribute Editing via Instance-Aware Latent Space Search
Yuxuan Han, Jiaolong Yang, Ying Fu
Recent works have shown that a rich set of semantic directions exist in the latent space of Generative Adversarial Networks (GANs), which enables various facial attribute editing a…
High-Resolution Optical Flow from 1D Attention and Correlation
Haofei Xu, Jiaolong Yang, Jianfei Cai +2
Optical flow is inherently a 2D search problem, and thus the computational complexity grows quadratically with respect to the search window, making large displacements matching inf…
Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondence
Yu Deng, Jiaolong Yang, Xin Tong
We propose a novel Deformed Implicit Field (DIF) representation for modeling 3D shapes of a category and generating dense correspondences among shapes. With DIF, a 3D shape is repr…
Deep 3D Portrait from a Single Image
Sicheng Xu, Jiaolong Yang, Dong Chen +4
In this paper, we present a learning-based approach for recovering the 3D geometry of human head from a single portrait image. Our method is learned in an unsupervised manner witho…
Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning
Yu Deng, Jiaolong Yang, Dong Chen +2
We propose DiscoFaceGAN, an approach for face image generation of virtual people with disentangled, precisely-controllable latent representations for identity of non-existing peopl…
Single Image Reflection Removal Exploiting Misaligned Training Data and Network Enhancements
Kaixuan Wei, Jiaolong Yang, Ying Fu +2
Removing undesirable reflections from a single image captured through a glass window is of practical importance to visual computing systems. Although state-of-the-art methods can o…