113 citations · 260 across the 33 of their papers we have counts for
33 papers
Controlling Character Motions without Observable Driving Source
Weiyuan Li, Bin Dai, Ziyi Zhou +2
How to generate diverse, life-like, and unlimited long head/body sequences without any driving source? We argue that this under-investigated research problem is non-trivial at all,…
Reinforced Disentanglement for Face Swapping without Skip Connection
Xiaohang Ren, Xingyu Chen, Pengfei Yao +2
The SOTA face swap models still suffer the problem of either target identity (i.e., shape) being leaked or the target non-identity attributes (i.e., background, hair) failing to be…
Visual Instruction Tuning with Polite Flamingo
Delong Chen, Jianfeng Liu, Wenliang Dai +1
Recent research has demonstrated that the multi-task fine-tuning of multi-modal Large Language Models (LLMs) using an assortment of annotated downstream vision-language datasets si…
LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming
Jingsheng Gao, Yixin Lian, Ziyi Zhou +2
Open-domain dialogue systems have made promising progress in recent years. While the state-of-the-art dialogue agents are built upon large-scale text-based social media data and la…
ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformers
Jingfeng Yao, Xinggang Wang, Shusheng Yang +1
Recently, plain vision Transformers (ViTs) have shown impressive performance on various computer vision tasks, thanks to their strong modeling capacity and large-scale pretraining.…
Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification
Ke Ji, Yixin Lian, Jingsheng Gao +1
Due to the complex label hierarchy and intensive labeling cost in practice, the hierarchical text classification (HTC) suffers a poor performance especially when low-resource or fe…
FashionTex: Controllable Virtual Try-on with Text and Texture
Anran Lin, Nanxuan Zhao, Shuliang Ning +3
Virtual try-on attracts increasing research attention as a promising way for enhancing the user experience for online cloth shopping. Though existing methods can generate impressiv…
An Effective Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds
Chaoda Zheng, Xu Yan, Haiming Zhang +4
3D single object tracking in LiDAR point clouds (LiDAR SOT) plays a crucial role in autonomous driving. Current approaches all follow the Siamese paradigm based on appearance match…
Mimic3D: Thriving 3D-Aware GANs via 3D-to-2D Imitation
Xingyu Chen, Yu Deng, Baoyuan Wang
Generating images with both photorealism and multiview 3D consistency is crucial for 3D-aware GANs, yet existing methods struggle to achieve them simultaneously. Improving the phot…
Orca: A Few-shot Benchmark for Chinese Conversational Machine Reading Comprehension
Nuo Chen, Hongguang Li, Junqing He +8
The conversational machine reading comprehension (CMRC) task aims to answer questions in conversations, which has been a hot research topic in recent years because of its wide appl…
Natural Response Generation for Chinese Reading Comprehension
Nuo Chen, Hongguang Li, Yinan Bao +2
Machine reading comprehension (MRC) is an important area of conversation agents and draws a lot of attention. However, there is a notable limitation to current MRC benchmarks: The…
Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priors
Zhentao Yu, Zixin Yin, Deyu Zhou +3
In this paper, we introduce a simple and novel framework for one-shot audio-driven talking head generation. Unlike prior works that require additional driving sources for controlle…
UDE: A Unified Driving Engine for Human Motion Generation
Zixiang Zhou, Baoyuan Wang
Generating controllable and editable human motion sequences is a key challenge in 3D Avatar generation. It has been labor-intensive to generate and animate human motion for a long…
Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesis
Duomin Wang, Yu Deng, Zixin Yin +2
We present a novel one-shot talking head synthesis method that achieves disentangled and fine-grained control over lip motion, eye gaze&blink, head pose, and emotional expression.…
Learning Detailed Radiance Manifolds for High-Fidelity and 3D-Consistent Portrait Synthesis from Monocular Image
Yu Deng, Baoyuan Wang, Heung-Yeung Shum
A key challenge for novel view synthesis of monocular portrait images is 3D consistency under continuous pose variations. Most existing methods rely on 2D generative models which o…
Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Video
Xingyu Chen, Baoyuan Wang, Heung-Yeung Shum
We present HandAvatar, a novel representation for hand animation and rendering, which can generate smoothly compositional geometry and self-occlusion-aware texture. Specifically, w…
Local-Adaptive Face Recognition via Graph-based Meta-Clustering and Regularized Adaptation
Wenbin Zhu, Chien-Yi Wang, Kuan-Lun Tseng +2
Due to the rising concern of data privacy, it's reasonable to assume the local client data can't be transferred to a centralized server, nor their associated identity label is prov…
Privacy-preserving Online AutoML for Domain-Specific Face Detection
Chenqian Yan, Yuge Zhang, Quanlu Zhang +4
Despite the impressive progress of general face detection, the tuning of hyper-parameters and architectures is still critical for the performance of a domain-specific face detector…
Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds
Chaoda Zheng, Xu Yan, Haiming Zhang +4
3D single object tracking (3D SOT) in LiDAR point clouds plays a crucial role in autonomous driving. Current approaches all follow the Siamese paradigm based on appearance matching…
CRFace: Confidence Ranker for Model-Agnostic Face Detection Refinement
Noranart Vesdapunt, Baoyuan Wang
Face detection is a fundamental problem for many downstream face applications, and there is a rising demand for faster, more accurate yet support for higher resolution face detecto…
Personalized Face Modeling for Improved Face Reconstruction and Motion Retargeting
Bindita Chaudhuri, Noranart Vesdapunt, Linda Shapiro +1
Traditional methods for image-based 3D face reconstruction and facial motion retargeting fit a 3D morphable model (3DMM) to the face, which has limited modeling capacity and fail t…
JNR: Joint-based Neural Rig Representation for Compact 3D Face Modeling
Noranart Vesdapunt, Mitch Rundle, HsiangTao Wu +1
In this paper, we introduce a novel approach to learn a 3D face model using a joint-based face rig and a neural skinning network. Thanks to the joint-based representation, our mode…
Animating Face using Disentangled Audio Representations
Gaurav Mittal, Baoyuan Wang
All previous methods for audio-driven talking head generation assume the input audio to be clean with a neutral tone. As we show empirically, one can easily break these systems by…
Joint Face Detection and Facial Motion Retargeting for Multiple Faces
Bindita Chaudhuri, Noranart Vesdapunt, Baoyuan Wang
Facial motion retargeting is an important problem in both computer graphics and vision, which involves capturing the performance of a human face and transferring it to another 3D c…