3.2k citations · 12.3k across the 227 of their papers we have counts for
32 papers · 1 filter
MoCaNet: Motion Retargeting in-the-wild via Canonicalization Networks
Wentao Zhu, Zhuoqian Yang, Ziang Di +3
We present a novel framework that brings the 3D motion retargeting task from controlled environments to in-the-wild scenarios. In particular, our method is capable of retargeting b…
Extract Free Dense Labels from CLIP
Chong Zhou, Chen Change Loy, Bo Dai
Contrastive Language-Image Pre-training (CLIP) has made a remarkable breakthrough in open-vocabulary zero-shot image recognition. Many recent studies leverage the pre-trained CLIP…
Investigating Tradeoffs in Real-World Video Super-Resolution
Kelvin C. K. Chan, Shangchen Zhou, Xiangyu Xu +1
The diversity and complexity of degradations in real-world video super-resolution (VSR) pose non-trivial challenges in inference and training. First, while long-term propagation le…
Deceive D: Adaptive Pseudo Augmentation for GAN Training with Limited Data
Liming Jiang, Bo Dai, Wayne Wu +1
Generative adversarial networks (GANs) typically require ample data for training in order to synthesize high-fidelity images. Recent studies have shown that training GANs with limi…
Monocular 3D Reconstruction of Interacting Hands via Collision-Aware Factorized Refinements
Yu Rong, Jingbo Wang, Ziwei Liu +1
3D interacting hand reconstruction is essential to facilitate human-machine interaction and human behaviors understanding. Previous works in this field either rely on auxiliary inp…
Self-Supervised Representation Learning: Introduction, Advances and Challenges
Linus Ericsson, Henry Gouk, Chen Change Loy +1
Self-supervised representation learning methods aim to provide powerful deep feature learning without the requirement of large annotated datasets, thus alleviating the annotation b…
Temporally Consistent Video Colorization with Deep Feature Propagation and Self-regularization Learning
Yihao Liu, Hengyuan Zhao, Kelvin C. K. Chan +4
Video colorization is a challenging and highly ill-posed problem. Although recent years have witnessed remarkable progress in single image colorization, there is relatively less re…
A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis
Xingang Pan, Xudong Xu, Chen Change Loy +2
The advancement of generative radiance fields has pushed the boundary of 3D-aware image synthesis. Motivated by the observation that a 3D object should look realistic from multiple…
The Nuts and Bolts of Adopting Transformer in GANs
Rui Xu, Xiangyu Xu, Kai Chen +2
Transformer becomes prevalent in computer vision, especially for high-level vision tasks. However, adopting Transformer in the generative adversarial network (GAN) framework is sti…
Playing for 3D Human Recovery
Zhongang Cai, Mingyuan Zhang, Jiawei Ren +7
Image- and video-based 3D human recovery (i.e., pose and shape estimation) have achieved substantial progress. However, due to the prohibitive cost of motion capture, existing data…
ReconfigISP: Reconfigurable Camera Image Processing Pipeline
Ke Yu, Zexian Li, Yue Peng +2
Image Signal Processor (ISP) is a crucial component in digital cameras that transforms sensor signals into images for us to perceive and understand. Existing ISP designs always ado…
Talk-to-Edit: Fine-Grained Facial Editing via Dialog
Yuming Jiang, Ziqi Huang, Xingang Pan +2
Facial editing is an important task in vision and graphics with numerous applications. However, existing works are incapable to deliver a continuous and fine-grained editing mode (…
3D Human Texture Estimation from a Single Image with Transformers
Xiangyu Xu, Chen Change Loy
We propose a Transformer-based framework for 3D human texture estimation from a single image. The proposed Transformer is able to effectively exploit the global information of the…
Learning to Prompt for Vision-Language Models
Kaiyang Zhou, Jingkang Yang, Chen Change Loy +1
Large pre-trained vision-language models like CLIP have shown great potential in learning representations that are transferable across a wide range of downstream tasks. Different f…
Robust Reference-based Super-Resolution via C2-Matching
Yuming Jiang, Kelvin C. K. Chan, Xintao Wang +2
Reference-based Super-Resolution (Ref-SR) has recently emerged as a promising paradigm to enhance a low-resolution (LR) input image by introducing an additional high-resolution (HR…
K-Net: Towards Unified Image Segmentation
Wenwei Zhang, Jiangmiao Pang, Kai Chen +1
Semantic, instance, and panoptic segmentations have been addressed using different and specialized frameworks despite their underlying connections. This paper presents a unified, s…
Unsupervised Object-Level Representation Learning from Scene Images
Jiahao Xie, Xiaohang Zhan, Ziwei Liu +2
Contrastive self-supervised learning has largely narrowed the gap to supervised pre-training on ImageNet. However, its success highly relies on the object-centric priors of ImageNe…
Semi-Supervised Domain Generalization with Stochastic StyleMatch
Kaiyang Zhou, Chen Change Loy, Ziwei Liu
Ideally, visual learning algorithms should be generalizable, for dealing with any unseen domain shift when deployed in a new target environment; and data-efficient, for reducing de…
Audio-Driven Emotional Video Portraits
Xinya Ji, Hang Zhou, Kaisiyuan Wang +4
Despite previous success in generating audio-driven talking heads, most of the previous studies focus on the correlation between speech content and the mouth shape. Facial emotion,…
Unsupervised 3D Shape Completion through GAN Inversion
Junzhe Zhang, Xinyi Chen, Zhongang Cai +6
Most 3D shape completion approaches rely heavily on partial-complete shape pairs and learn in a fully supervised manner. Despite their impressive performances on in-domain data, wh…
BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment
Kelvin C. K. Chan, Shangchen Zhou, Xiangyu Xu +1
A recurrent structure is a popular framework choice for the task of video super-resolution. The state-of-the-art method BasicVSR adopts bidirectional propagation with feature align…
Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation
Hang Zhou, Yasheng Sun, Wayne Wu +3
While accurate lip synchronization has been achieved for arbitrary-subject audio-driven talking face generation, the problem of how to efficiently drive the head pose remains. Prev…
Removing Diffraction Image Artifacts in Under-Display Camera via Dynamic Skip Connection Network
Ruicheng Feng, Chongyi Li, Huaijin Chen +3
Recent development of Under-Display Camera (UDC) systems provides a true bezel-less and notch-free viewing experience on smartphones (and TV, laptops, tablets), while allowing imag…
Everything's Talkin': Pareidolia Face Reenactment
Linsen Song, Wayne Wu, Chaoyou Fu +3
We present a new application direction named Pareidolia Face Reenactment, which is defined as animating a static illusory face to move in tandem with a human face in the video. For…