activity
20152023
most citedMakeItTalk: Speaker-Aware Talking-Head Animation

321 citations · 1.3k across the 29 of their papers we have counts for

collaborators

30 papers

cs.SD2023

CoverHunter: Cover Song Identification with Refined Attention and Alignments

Feng Liu, Deyi Tuo, Yinan Xu +1

Abstract: Cover song identification (CSI) focuses on finding the same music with different versions in reference anchors given a query track. In this paper, we propose a novel syst…

cs.CV2023

XFormer: Fast and Accurate Monocular 3D Body Capture

Lihui Qian, Xintong Han, Faqiang Wang +6

We present XFormer, a novel human mesh and motion capture method that achieves real-time performance on consumer CPUs given only monocular images as input. The proposed network arc…

cs.CV2023★ 1 cited

PromptFusion: Decoupling Stability and Plasticity for Continual Learning

Haoran Chen, Zuxuan Wu, Xintong Han +2

Current research on continual learning mainly focuses on relieving catastrophic forgetting, and most of their success is at the cost of limiting the performance of newly incoming t…

cs.CV2023★ 5 cited

Human MotionFormer: Transferring Human Motions with Vision Transformers

Hongyu Liu, Xintong Han, Chengbin Jin +8

Human motion transfer aims to transfer motions from a target dynamic person to a source static one for motion synthesis. An accurate matching between the source person and the targ…

cs.CV2022★ 17 cited

One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulations

Yiming Zhu, Hongyu Liu, Yibing Song +5

Free-form text prompts allow users to describe their intentions during image manipulation conveniently. Based on the visual latent space of StyleGAN[21] and text embedding space of…

cs.CV2022★ 9 cited

ObjectFormer for Image Manipulation Detection and Localization

Junke Wang, Zuxuan Wu, Jingjing Chen +4

Recent advances in image editing techniques have posed serious challenges to the trustworthiness of multimedia data, which drives the research of image tampering detection. In this…

cs.CV2021★ 3 cited

PD-GAN: Probabilistic Diverse GAN for Image Inpainting

Hongyu Liu, Ziyu Wan, Wei Huang +3

We propose PD-GAN, a probabilistic diverse GAN for image inpainting. Given an input image with arbitrary hole regions, PD-GAN produces multiple inpainting results with diverse and…

cs.CV2021

Few-Shot Human Motion Transfer by Personalized Geometry and Texture Modeling

Zhichao Huang, Xintong Han, Jia Xu +1

We present a new method for few-shot human motion transfer that achieves realistic human image generation with only a small number of appearance inputs. Despite recent advances in…

cs.CV2021

DeFLOCNet: Deep Image Editing via Flexible Low-level Controls

Hongyu Liu, Ziyu Wan, Wei Huang +5

User-intended visual content fills the hole regions of an input image in the image editing scenario. The coarse low-level inputs, which typically consist of sparse sketch lines and…

cs.CV2020★ 1 cited

Learning 3D Face Reconstruction with a Pose Guidance Network

Pengpeng Liu, Xintong Han, Michael Lyu +2

We present a self-supervised learning approach to learning monocular 3D face reconstruction with a pose guidance network (PGN). First, we unveil the bottleneck of pose estimation i…

cs.CV2020★ 321 cited

MakeItTalk: Speaker-Aware Talking-Head Animation

Yang Zhou, Xintong Han, Eli Shechtman +3

We present a method that generates expressive talking heads from a single facial image with audio as the only input. In contrast to previous approaches that attempt to learn direct…

cs.CV2020★ 2 cited

Channel Interaction Networks for Fine-Grained Image Categorization

Yu Gao, Xintong Han, Xun Wang +2

Fine-grained image categorization is challenging due to the subtle inter-class differences.We posit that exploiting the rich relationships between channels can help capture such di…

cs.CV2020

iFAN: Image-Instance Full Alignment Networks for Adaptive Object Detection

Chenfan Zhuang, Xintong Han, Weilin Huang +1

Training an object detector on a data-rich domain and applying it to a data-poor one with limited performance drop is highly attractive in industry, because it saves huge annotatio…

eess.IV2019★ 64 cited

Partition-Aware Adaptive Switching Neural Networks for Post-Processing in HEVC

Weiyao Lin, Xiaoyi He, Xintong Han +5

This paper addresses neural network based post-processing for the state-of-the-art video coding standard, High Efficiency Video Coding (HEVC). We first propose a partition-aware Co…

cs.MM2019

A multimodal lossless coding method for skeletons in videos

Mingzhou Liu, Xiaoyi He, Weiyao Lin +4

Nowadays, skeleton information in videos plays an important role in human-centric video analysis but effective coding such massive skeleton information has never been addressed in…

cs.CV2019★ 104 cited

Multi-Similarity Loss with General Pair Weighting for Deep Metric Learning

Xun Wang, Xintong Han, Weilin Huang +2

A family of loss functions built on pair-based computation have been proposed in the literature which provide a myriad of solutions for deep metric learning. In this paper, we prov…

cs.CV2019★ 19 cited

Compatible and Diverse Fashion Image Inpainting

Xintong Han, Zuxuan Wu, Weilin Huang +2

Visual compatibility is critical for fashion analysis, yet is missing in existing fashion image synthesis systems. In this paper, we propose to explicitly model visual compatibilit…

cs.CV2018★ 11 cited

Generate, Segment and Refine: Towards Generic Manipulation Segmentation

Peng Zhou, Bor-Chun Chen, Xintong Han +4

Detecting manipulated images has become a significant emerging challenge. The advent of image sharing platforms and the easy availability of advanced photo editing software have re…

cs.MM2018★ 78 cited

Enhancing HEVC Compressed Videos with a Partition-masked Convolutional Neural Network

Xiaoyi He, Qiang Hu, Xintong Han +3

In this paper, we propose a partition-masked Convolution Neural Network (CNN) to achieve compressed-video enhancement for the state-of-the-art coding standard, High Efficiency Vide…

cs.CV2018★ 81 cited

Learning Rich Features for Image Manipulation Detection

Peng Zhou, Xintong Han, Vlad I. Morariu +1

Image manipulation detection is different from traditional semantic object detection because it pays more attention to tampering artifacts than to image content, which suggests tha…

cs.CV2018★ 22 cited

DCAN: Dual Channel-wise Alignment Networks for Unsupervised Scene Adaptation

Zuxuan Wu, Xintong Han, Yen-Liang Lin +4

Harvesting dense pixel-level annotations to train deep neural networks for semantic segmentation is extremely expensive and unwieldy at scale. While learning from synthetic data wh…

cs.CV2018★ 57 cited

Two-Stream Neural Networks for Tampered Face Detection

Peng Zhou, Xintong Han, Vlad I. Morariu +1

We propose a two-stream network for face tampering detection. We train GoogLeNet to detect tampering artifacts in a face classification stream, and train a patch based triplet netw…

cs.CV2017★ 24 cited

VITON: An Image-based Virtual Try-on Network

Xintong Han, Zuxuan Wu, Zhe Wu +2

We present an image-based VIirtual Try-On Network (VITON) without using 3D information in any form, which seamlessly transfers a desired clothing item onto the corresponding region…

cs.CV2017★ 62 cited

NISP: Pruning Networks using Neuron Importance Score Propagation

Ruichi Yu, Ang Li, Chun-Fu Chen +6

To reduce the significant redundancy in deep Convolutional Neural Networks (CNNs), most existing methods prune neurons by only considering statistics of an individual layer or two…