361 citations · 429 across the 22 of their papers we have counts for
24 papers
OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting
Yongsheng Yu, Ziyun Zeng, Haitian Zheng +1
Diffusion-based generative models have revolutionized object-oriented image editing, yet their deployment in realistic object removal and insertion remains hampered by challenges s…
Jurassic World Remake: Bringing Ancient Fossils Back to Life via Zero-Shot Long Image-to-Image Translation
Alexander Martin, Haitian Zheng, Jie An +1
With a strong understanding of the target domain from natural language, we produce promising results in translating across large domain gaps and bringing skeletons back to life. In…
Improving Video Colorization by Test-Time Tuning
Yaping Zhao, Haitian Zheng, Jiebo Luo +1
With the advancements in deep learning, video colorization by propagating color information from a colorized reference frame to a monochrome video sequence has been well explored.…
Structure-Guided Image Completion with Image-level and Object-level Semantic Discriminators
Haitian Zheng, Zhe Lin, Jingwan Lu +8
Structure-guided image completion aims to inpaint a local region of an image according to an input guidance map from users. While such a task enables many practical applications fo…
Cross-Camera Deep Colorization
Yaping Zhao, Haitian Zheng, Mengqi Ji +1
In this paper, we consider the color-plus-mono dual-camera system and propose an end-to-end convolutional neural network to align and fuse images from it in an efficient and cost-e…
CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training
Haitian Zheng, Zhe Lin, Jingwan Lu +7
Recent image inpainting methods have made great progress but often struggle to generate plausible image structures when dealing with large holes in complex images. This is partiall…
Point Cloud Denoising via Momentum Ascent in Gradient Fields
Yaping Zhao, Haitian Zheng, Zhongrui Wang +2
To achieve point cloud denoising, traditional methods heavily rely on geometric priors, and most learning-based approaches suffer from outliers and loss of details. Recently, the g…
MANet: Improving Video Denoising with a Multi-Alignment Network
Yaping Zhao, Haitian Zheng, Zhongrui Wang +2
In video denoising, the adjacent frames often provide very useful information, but accurate alignment is needed before such information can be harnassed. In this work, we present a…
SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editing
Jing Shi, Ning Xu, Haitian Zheng +3
Recently, large pretrained models (e.g., BERT, StyleGAN, CLIP) have shown great knowledge transfer and generalization capability on various downstream tasks within their domains. I…
Learning to Aggregate and Refine Noisy Labels for Visual Sentiment Analysis
Wei Zhu, Zihe Zheng, Haitian Zheng +2
Visual sentiment analysis has received increasing attention in recent years. However, the dataset's quality is a concern because the sentiment labels are crowd-sourcing, subjective…
Learning Bias-Invariant Representation by Cross-Sample Mutual Information Minimization
Wei Zhu, Haitian Zheng, Haofu Liao +2
Deep learning algorithms mine knowledge from the training data and thus would likely inherit the dataset's bias information. As a result, the obtained model would generalize poorly…
Semantic Layout Manipulation with High-Resolution Sparse Attention
Haitian Zheng, Zhe Lin, Jingwan Lu +4
We tackle the problem of semantic image layout manipulation, which aims to manipulate an input image by editing its semantic label map. A core problem of this task is how to transf…
Actor-Action Video Classification CSC 249/449 Spring 2020 Challenge Report
Jing Shi, Zhiheng Li, Haitian Zheng +30
This technical report summarizes submissions and compiles from Actor-Action video classification challenge held as a final project in CSC 249/449 Machine Vision course (Spring 2020…
Image Sentiment Transfer
Tianlang Chen, Wei Xiong, Haitian Zheng +1
In this work, we introduce an important but still unexplored research task -- image sentiment transfer. Compared with other related tasks that have been well-studied, such as image…
Personalized Fashion Recommendation from Personal Social Media Data: An Item-to-Set Metric Learning Approach
Haitian Zheng, Kefei Wu, Jong-Hwi Park +2
With the growth of online shopping for fashion products, accurate fashion recommendation has become a critical problem. Meanwhile, social networks provide an open and new data sour…
What comprises a good talking-head video generation?: A Survey and Benchmark
Lele Chen, Guofeng Cui, Ziyi Kou +2
Over the years, performance evaluation has become essential in computer vision, enabling tangible progress in many sub-fields. While talking-head video generation has become an eme…
Example-Guided Image Synthesis across Arbitrary Scenes using Masked Spatial-Channel Attention and Self-Supervision
Haitian Zheng, Haofu Liao, Lele Chen +3
Example-guided image synthesis has recently been attempted to synthesize an image from a semantic label map and an exemplary image. In the task, the additional exemplar image provi…
Example-Guided Scene Image Synthesis using Masked Spatial-Channel Attention and Patch-Based Self-Supervision
Haitian Zheng, Haofu Liao, Lele Chen +3
Example-guided image synthesis has been recently attempted to synthesize an image from a semantic label map and an exemplary image. In the task, the additional exemplary image serv…
Unsupervised Pose Flow Learning for Pose Guided Synthesis
Haitian Zheng, Lele Chen, Chenliang Xu +1
Pose guided synthesis aims to generate a new image in an arbitrary target pose while preserving the appearance details from the source image. Existing approaches rely on either har…
CrossNet: An End-to-end Reference-based Super Resolution Network using Cross-scale Warping
Haitian Zheng, Mengqi Ji, Haoqian Wang +2
The Reference-based Super-resolution (RefSR) super-resolves a low-resolution (LR) image given an external high-resolution (HR) reference image, where the reference image and LR ima…
SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsis
Mengqi Ji, Juergen Gall, Haitian Zheng +2
This paper proposes an end-to-end learning framework for multiview stereopsis. We term the network SurfaceNet. It takes a set of images and their corresponding camera parameters as…
Utilizing High-level Visual Feature for Indoor Shopping Mall Navigation
Ziwei Xu, Haitian Zheng, Minjian Pang +4
Towards robust and convenient indoor shopping mall navigation, we propose a novel learning-based scheme to utilize the high-level visual information from the storefront images capt…
Deep Learning for Surface Material Classification Using Haptic And Visual Information
Haitian Zheng, Lu Fang, Mengqi Ji +3
When a user scratches a hand-held rigid tool across an object surface, an acceleration signal can be captured, which carries relevant information about the surface. More importantl…
Learning High-level Prior with Convolutional Neural Networks for Semantic Segmentation
Haitian Zheng, Yebin Liu, Mengqi Ji +2
This paper proposes a convolutional neural network that can fuse high-level prior for semantic image segmentation. Motivated by humans' vision recognition system, our key design is…