219 citations · 420 across the 28 of their papers we have counts for
28 papers
Semi-supervised Cycle-GAN for face photo-sketch translation in the wild
Chaofeng Chen, Wei Liu, Xiao Tan +1
The performance of face photo-sketch translation has improved a lot thanks to deep neural networks. GAN based methods trained on paired images can produce high-quality results unde…
DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models
Yukang Cao, Yan-Pei Cao, Kai Han +2
We present DreamAvatar, a text-and-shape guided framework for generating high-quality 3D human avatars with controllable poses. While encouraging results have been reported by rece…
SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstruction
Yukang Cao, Kai Han, Kwan-Yee K. Wong
We address the problem of clothed human reconstruction from a single image or uncalibrated multi-view images. Existing methods struggle with reconstructing detailed geometry of a c…
Learning Attention as Disentangler for Compositional Zero-shot Learning
Shaozhe Hao, Kai Han, Kwan-Yee K. Wong
Compositional zero-shot learning (CZSL) aims at learning visual concepts (i.e., attributes and objects) from seen compositions and combining concept knowledge into unseen compositi…
S-NeRF: Neural Reflectance Field from Shading and Shadow under a Single Viewpoint
Wenqi Yang, Guanying Chen, Chaofeng Chen +2
In this paper, we address the "dual problem" of multi-view scene reconstruction in which we utilize single-view images captured under different point lights to learn a neural scene…
PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo
Wenqi Yang, Guanying Chen, Chaofeng Chen +2
Traditional multi-view photometric stereo (MVPS) methods are often composed of multiple disjoint stages, resulting in noticeable accumulated errors. In this paper, we present a neu…
JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstruction
Yukang Cao, Guanying Chen, Kai Han +2
This paper addresses the problem of single view 3D human reconstruction. Recent implicit function based methods have shown impressive results, but they fail to recover fine face de…
A Unified Framework for Masked and Mask-Free Face Recognition via Feature Rectification
Shaozhe Hao, Chaofeng Chen, Zhenfang Chen +1
Face recognition under ideal conditions is now considered a well-solved problem with advances in deep learning. Recognizing faces under occlusion, however, still remains a challeng…
Deep Face Video Inpainting via UV Mapping
Wenqi Yang, Zhenfang Chen, Chaofeng Chen +2
This paper addresses the problem of face video inpainting. Existing video inpainting methods target primarily at natural scenes with repetitive patterns. They do not make use of an…
Dense Reconstruction of Transparent Objects by Altering Incident Light Paths Through Refraction
Kai Han, Kwan-Yee K. Wong, Miaomiao Liu
This paper addresses the problem of reconstructing the surface shape of transparent objects. The difficulty of this problem originates from the viewpoint dependent appearance of a…
Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning
Zhenfang Chen, Jiayuan Mao, Jiajun Wu +3
We study the problem of dynamic visual reasoning on raw videos. This is a challenging problem; currently, state-of-the-art models often require dense supervision on physical object…
HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark Dataset
Guanying Chen, Chaofeng Chen, Shi Guo +3
High dynamic range (HDR) video reconstruction from sequences captured with alternating exposures is a very challenging problem. Existing methods often align low dynamic range (LDR)…
Fixed Viewpoint Mirror Surface Reconstruction under an Uncalibrated Camera
Kai Han, Miaomiao Liu, Dirk Schnieders +1
This paper addresses the problem of mirror surface reconstruction, and proposes a solution based on observing the reflections of a moving reference plane on the mirror surface. Unl…
Learning Spatial Attention for Face Super-Resolution
Chaofeng Chen, Dihong Gong, Hao Wang +2
General image super-resolution techniques have difficulties in recovering detailed face structures when applying to low resolution face images. Recent deep learning based methods t…
Face Sketch Synthesis with Style Transfer using Pyramid Column Feature
Chaofeng Chen, Xiao Tan, Kwan-Yee K. Wong
In this paper, we propose a novel framework based on deep neural networks for face sketch synthesis from a photo. Imitating the process of how artists draw sketches, our framework…
Progressive Semantic-Aware Style Transformation for Blind Face Restoration
Chaofeng Chen, Xiaoming Li, Lingbo Yang +3
Face restoration is important in face image processing, and has been widely studied in recent years. However, previous works often fail to generate plausible high quality (HQ) resu…
Deep Photometric Stereo for Non-Lambertian Surfaces
Guanying Chen, Kai Han, Boxin Shi +2
This paper addresses the problem of photometric stereo, in both calibrated and uncalibrated scenarios, for non-Lambertian surfaces based on deep learning. We first introduce a full…
Cops-Ref: A new Dataset and Task on Compositional Referring Expression Comprehension
Zhenfang Chen, Peng Wang, Lin Ma +2
Referring expression comprehension (REF) aims at identifying a particular object in a scene by a natural language expression. It requires joint reasoning over the textual and visua…
Look Closer to Ground Better: Weakly-Supervised Temporal Grounding of Sentence in Video
Zhenfang Chen, Lin Ma, Wenhan Luo +2
In this paper, we study the problem of weakly-supervised temporal grounding of sentence in video. Specifically, given an untrimmed video and a query sentence, our goal is to locali…
Colored Transparent Object Matting from a Single Image Using Deep Learning
Jamal Ahmed Rahim, Kwan-Yee Kenneth Wong
This paper proposes a deep learning based method for colored transparent object matting from a single image. Existing approaches for transparent object matting often require multip…
Learning Transparent Object Matting
Guanying Chen, Kai Han, Kwan-Yee K. Wong
This paper addresses the problem of image matting for transparent objects. Existing approaches often require tedious capturing procedures and long processing time, which limit thei…
Weakly-Supervised Spatio-Temporally Grounding Natural Sentence in Video
Zhenfang Chen, Lin Ma, Wenhan Luo +1
In this paper, we address a novel task, namely weakly-supervised spatio-temporally grounding natural sentence in video. Specifically, given a natural sentence and a video, we local…
Self-calibrating Deep Photometric Stereo Networks
Guanying Chen, Kai Han, Boxin Shi +2
This paper proposes an uncalibrated photometric stereo method for non-Lambertian scenes based on deep learning. Unlike previous approaches that heavily rely on assumptions of speci…
SAFE: Scale Aware Feature Encoder for Scene Text Recognition
Wei Liu, Chaofeng Chen, Kwan-Yee K. Wong
In this paper, we address the problem of having characters with different scales in scene text recognition. We propose a novel scale aware feature encoder (SAFE) that is designed s…