3.2k citations · 12.3k across the 227 of their papers we have counts for
42 papers · 1 filter
Correspondence Distillation from NeRF-based GAN
Yushi Lan, Chen Change Loy, Bo Dai
The neural radiance field (NeRF) has shown promising results in preserving the fine details of objects and scenes. However, unlike mesh-based representations, it remains an open pr…
Self-Supervised Geometry-Aware Encoder for Style-Based 3D GAN Inversion
Yushi Lan, Xuyi Meng, Shuai Yang +2
StyleGAN has achieved great progress in 2D face reconstruction and semantic editing via image inversion and latent editing. While studies over extending 2D StyleGAN to 3D faces hav…
BeautyREC: Robust, Efficient, and Content-preserving Makeup Transfer
Qixin Yan, Chunle Guo, Jixin Zhao +3
In this work, we propose a Robust, Efficient, and Component-specific makeup transfer method (abbreviated as BeautyREC). A unique departure from prior methods that leverage global a…
Reference-based Image and Video Super-Resolution via C2-Matching
Yuming Jiang, Kelvin C. K. Chan, Xintao Wang +2
Reference-based Super-Resolution (Ref-SR) has recently emerged as a promising paradigm to enhance a low-resolution (LR) input image or video by introducing an additional high-resol…
DifFace: Blind Face Restoration with Diffused Error Contraction
Zongsheng Yue, Chen Change Loy
While deep learning-based methods for blind face restoration have achieved unprecedented success, they still suffer from two major limitations. First, most of them deteriorate when…
AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies
Li Siyao, Yuhang Li, Bo Li +3
Existing correspondence datasets for two-dimensional (2D) cartoon suffer from simple frame composition and monotonic movements, making them insufficient to simulate real animations…
MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Results
Ruicheng Feng, Chongyi Li, Shangchen Zhou +6
Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobi…
Unified Vision and Language Prompt Learning
Yuhang Zang, Wei Li, Kaiyang Zhou +2
Prompt tuning, a parameter- and data-efficient transfer learning paradigm that tunes only a small number of parameters in a model's input space, has become a trend in the vision co…
Flare7K: A Phenomenological Nighttime Flare Removal Dataset
Yuekun Dai, Chongyi Li, Shangchen Zhou +2
Artificial lights commonly leave strong lens flare artifacts on images captured at night. Nighttime flare not only affects the visual quality but also degrades the performance of v…
Deep Fourier Up-Sampling
Man Zhou, Hu Yu, Jie Huang +5
Existing convolutional neural networks widely adopt spatial down-/up-sampling for multi-scale modeling. However, spatial up-sampling operators (\emph{e.g.}, interpolation, transpos…
VToonify: Controllable High-Resolution Portrait Video Style Transfer
Shuai Yang, Liming Jiang, Ziwei Liu +1
Generating high-quality artistic portrait videos is an important and desirable task in computer graphics and vision. Although a series of successful portrait image toonification mo…
MIPI 2022 Challenge on RGBW Sensor Fusion: Dataset and Report
Qingyu Yang, Guang Yang, Jun Jiang +7
Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobi…
MIPI 2022 Challenge on RGBW Sensor Re-mosaic: Dataset and Report
Qingyu Yang, Guang Yang, Jun Jiang +7
Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobi…
MIPI 2022 Challenge on Quad-Bayer Re-mosaic: Dataset and Report
Qingyu Yang, Guang Yang, Jun Jiang +7
Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobi…
MIPI 2022 Challenge on RGB+ToF Depth Completion: Dataset and Report
Wenxiu Sun, Qingpeng Zhu, Chongyi Li +6
Developing and integrating advanced image sensors with novel algorithms in camera systems is prevalent with the increasing demand for computational photography and imaging on mobil…
On-Device Domain Generalization
Kaiyang Zhou, Yuanhan Zhang, Yuhang Zang +3
We present a systematic study of domain generalization (DG) for tiny neural networks. This problem is critical to on-device machine learning applications but has been overlooked in…
Mind the Gap in Distilling StyleGANs
Guodong Xu, Yuenan Hou, Ziwei Liu +1
StyleGAN family is one of the most popular Generative Adversarial Networks (GANs) for unconditional generation. Despite its impressive performance, its high demand on storage and c…
GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond
Kelvin C. K. Chan, Xiangyu Xu, Xintao Wang +2
We show that pre-trained Generative Adversarial Networks (GANs) such as StyleGAN and BigGAN can be used as a latent bank to improve the performance of image super-resolution. While…
StyleLight: HDR Panorama Generation for Lighting Estimation and Editing
Guangcong Wang, Yinuo Yang, Chen Change Loy +1
We present a new lighting estimation and editing framework to generate high-dynamic-range (HDR) indoor panorama lighting from a single limited field-of-view (LFOV) image captured b…
CelebV-HQ: A Large-Scale Video Facial Attributes Dataset
Hao Zhu, Wayne Wu, Wentao Zhu +5
Large-scale datasets have played indispensable roles in the recent success of face generation/editing and significantly facilitated the advances of emerging research fields. Howeve…
Transformer with Implicit Edges for Particle-based Physics Simulation
Yidi Shao, Chen Change Loy, Bo Dai
Particle-based systems provide a flexible and unified way to simulate physics systems with complex dynamics. Most existing data-driven simulators for particle-based systems adopt g…
BRACE: The Breakdancing Competition Dataset for Dance Motion Synthesis
Davide Moltisanti, Jinyi Wu, Bo Dai +1
Generative models for audio-conditioned dance motion synthesis map music features to dance movements. Models are trained to associate motion patterns to audio patterns, usually wit…
Monocular 3D Object Reconstruction with GAN Inversion
Junzhe Zhang, Daxuan Ren, Zhongang Cai +3
Recovering a textured 3D mesh from a monocular image is highly challenging, particularly for in-the-wild objects that lack 3D ground truths. In this work, we present MeshInversion,…
CuDi: Curve Distillation for Efficient and Controllable Exposure Adjustment
Chongyi Li, Chunle Guo, Ruicheng Feng +2
We present Curve Distillation, CuDi, for efficient and controllable exposure adjustment without the requirement of paired or unpaired data during training. Our method inherits the…