254 citations · 441 across the 21 of their papers we have counts for
21 papers
Amodal SAM: A Unified Amodal Segmentation Framework with Generalization
Bo Zhang, Zhuotao Tian, Xin Tao +3
Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus…
Perception-Oriented Video Frame Interpolation via Asymmetric Blending
Guangyang Wu, Xin Tao, Changlin Li +3
Previous methods for Video Frame Interpolation (VFI) have encountered challenges, notably the manifestation of blur and ghosting effects. These issues can be traced back to two piv…
1st Place Solution for the 5th LSVOS Challenge: Video Instance Segmentation
Tao Zhang, Xingye Tian, Yikang Zhou +7
Video instance segmentation is a challenging task that serves as the cornerstone of numerous downstream applications, including video editing and autonomous driving. In this report…
Scene-Generalizable Interactive Segmentation of Radiance Fields
Songlin Tang, Wenjie Pei, Xin Tao +3
Existing methods for interactive segmentation in radiance fields entail scene-specific optimization and thus cannot generalize across different scenes, which greatly limits their a…
Feature Decoupling-Recycling Network for Fast Interactive Segmentation
Huimin Zeng, Weinong Wang, Xin Tao +3
Recent interactive segmentation methods iteratively take source image, user guidance and previously predicted mask as the input without considering the invariant nature of the sour…
H-VFI: Hierarchical Frame Interpolation for Videos with Large Motions
Changlin Li, Guangyang Wu, Yanan Sun +3
Capitalizing on the rapid development of neural networks, recent video frame interpolation (VFI) methods have achieved notable improvements. However, they still fall short for real…
DeViT: Deformed Vision Transformers in Video Inpainting
Jiayin Cai, Changlin Li, Xin Tao +2
This paper proposes a novel video inpainting method. We make three main contributions: First, we extended previous Transformers with patch alignment by introducing Deformed Patch-b…
Look Back and Forth: Video Super-Resolution with Explicit Temporal Difference Modeling
Takashi Isobe, Xu Jia, Xin Tao +6
Temporal modeling is crucial for video super-resolution. Most of the video super-resolution methods adopt the optical flow or deformable convolution for explicitly motion compensat…
MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolution
Liying Lu, Wenbo Li, Xin Tao +2
Reference-based image super-resolution (RefSR) has shown promising success in recovering high-frequency details by utilizing an external reference image (Ref). In this task, textur…
MuCAN: Multi-Correspondence Aggregation Network for Video Super-Resolution
Wenbo Li, Xin Tao, Taian Guo +3
Video super-resolution (VSR) aims to utilize multiple low-resolution frames to generate a high-resolution prediction for each frame. In this process, inter- and intra-frames are th…
VCNet: A Robust Approach to Blind Image Inpainting
Yi Wang, Ying-Cong Chen, Xin Tao +1
Blind inpainting is a task to automatically complete visual contents without specifying masks for missing areas in an image. Previous works assume missing region patterns are known…
Robust Conditional GAN from Uncertainty-Aware Pairwise Comparisons
Ligong Han, Ruijiang Gao, Mun Kim +3
Conditional generative adversarial networks have shown exceptional generation performance over the past few years. However, they require large numbers of annotations. To address th…
Landmark Assisted CycleGAN for Cartoon Face Generation
Ruizheng Wu, Xiaodong Gu, Xin Tao +3
In this paper, we are interested in generating an cartoon face of a person by using unpaired training data between real faces and cartoon ones. A major challenge of this task is th…
Attribute-Driven Spontaneous Motion in Unpaired Image Translation
Ruizheng Wu, Xin Tao, Xiaodong Gu +2
Current image translation methods, albeit effective to produce high-quality results in various applications, still do not consider much geometric transform. We in this paper propos…
Image Inpainting via Generative Multi-column Convolutional Neural Networks
Yi Wang, Xin Tao, Xiaojuan Qi +2
In this paper, we propose a generative multi-column network for image inpainting. This network synthesizes different image components in a parallel manner within one stage. To bett…
Facelet-Bank for Fast Portrait Manipulation
Ying-Cong Chen, Huaijia Lin, Michelle Shu +5
Digital face manipulation has become a popular and fascinating way to touch images with the prevalence of smartphones and social networks. With a wide variety of user preferences,…
Scale-recurrent Network for Deep Image Deblurring
Xin Tao, Hongyun Gao, Yi Wang +3
In single image deblurring, the "coarse-to-fine" scheme, i.e. gradually restoring the sharp image on different resolutions in a pyramid, is very successful in both traditional opti…
Zero-order Reverse Filtering
Xin Tao, Chao Zhou, Xiaoyong Shen +2
In this paper, we study an unconventional but practically meaningful reversibility problem of commonly used image filters. We broadly define filters as operations to smooth images…
Detail-revealing Deep Video Super-resolution
Xin Tao, Hongyun Gao, Renjie Liao +2
Previous CNN-based video super-resolution approaches need to align multiple frames to the reference. In this paper, we show that proper frame alignment and motion compensation is c…
High-Quality Correspondence and Segmentation Estimation for Dual-Lens Smart-Phone Portraits
Xiaoyong Shen, Hongyun Gao, Xin Tao +2
Estimating correspondence between two images and extracting the foreground object are two challenges in computer vision. With dual-lens smart phones, such as iPhone 7Plus and Huawe…
Convolutional Neural Pyramid for Image Processing
Xiaoyong Shen, Ying-Cong Chen, Xin Tao +1
We propose a principled convolutional neural pyramid (CNP) framework for general low-level vision and image processing tasks. It is based on the essential finding that many applica…