1.9k citations · 3.4k across the 63 of their papers we have counts for
18 papers · 1 filter
Vision-Infused Deep Audio Inpainting
Hang Zhou, Ziwei Liu, Xudong Xu +2
Multi-modality perception is essential to develop interactive intelligence. In this work, we consider a new task of visual information-infused audio inpainting, \ie synthesizing mi…
Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesis
Xihui Liu, Guojun Yin, Jing Shao +2
Semantic image synthesis aims at generating photorealistic images from semantic layouts. Previous approaches with conditional generative adversarial networks (GAN) show state-of-th…
CAMP: Cross-Modal Adaptive Message Passing for Text-Image Retrieval
Zihao Wang, Xihui Liu, Hongsheng Li +4
Text-image cross-modal retrieval is a challenging task in the field of language and vision. Most previous approaches independently embed images and sentences into a joint embedding…
Deep Self-Learning From Noisy Labels
Jiangfan Han, Ping Luo, Xiaogang Wang
ConvNets achieve good results when training from clean data, but learning from noisy labels significantly degrades performances and remains challenging. Unlike previous works const…
Differentiable Learning-to-Group Channels via Groupable Convolutional Neural Networks
Zhaoyang Zhang, Jingyu Li, Wenqi Shao +4
Group convolution, which divides the channels of ConvNets into groups, has achieved impressive improvement over the regular convolution operation. However, existing models, eg. Res…
Once a MAN: Towards Multi-Target Attack via Learning Multi-Target Adversarial Network Once
Jiangfan Han, Xiaoyi Dong, Ruimao Zhang +5
Modern deep neural networks are often vulnerable to adversarial samples. Based on the first optimization-based attacking method, many following methods are proposed to improve the…
Interpolated Convolutional Networks for 3D Point Cloud Understanding
Jiageng Mao, Xiaogang Wang, Hongsheng Li
Point cloud is an important type of 3D representation. However, directly applying convolutions on point clouds is challenging due to the sparse, irregular and unordered data struct…
Multi-modality Latent Interaction Network for Visual Question Answering
Peng Gao, Haoxuan You, Zhanpeng Zhang +2
Exploiting relationships between visual regions and question words have achieved great success in learning multi-modality features for Visual Question Answering (VQA). However, we…
Disentangling Pose from Appearance in Monochrome Hand Images
Yikang Li, Chris Twigg, Yuting Ye +2
Hand pose estimation from the monocular 2D image is challenging due to the variation in lighting, appearance, and background. While some success has been achieved using deep neural…
Conditional Adversarial Generative Flow for Controllable Image Synthesis
Rui Liu, Yu Liu, Xinyu Gong +2
Flow-based generative models show great potential in image synthesis due to its reversible pipeline and exact log-likelihood target, yet it suffers from weak ability for conditiona…
Semantics Disentangling for Text-to-Image Generation
Guojun Yin, Bin Liu, Lu Sheng +3
Synthesizing photo-realistic images from text descriptions is a challenging problem. Previous studies have shown remarkable progresses on visual quality of the generated images. In…
Context and Attribute Grounded Dense Captioning
Guojun Yin, Lu Sheng, Bin Liu +3
Dense captioning aims at simultaneously localizing semantic regions and describing these regions-of-interest (ROIs) with short phrases or sentences in natural language. Previous st…
Feature Intertwiner for Object Detection
Hongyang Li, Bo Dai, Shaoshuai Shi +2
A well-trained model should classify objects with a unanimous score for every category. This requires the high-level semantic features should be as much alike as possible among sam…
GS3D: An Efficient 3D Object Detection Framework for Autonomous Driving
Buyu Li, Wanli Ouyang, Lu Sheng +2
We present an efficient 3D object detection framework based on a single RGB image in the scenario of autonomous driving. Our efforts are put on extracting the underlying 3D informa…
Weakly-Supervised Discovery of Geometry-Aware Representation for 3D Human Pose Estimation
Xipeng Chen, Kwan-Yee Lin, Wentao Liu +3
Recent studies have shown remarkable advances in 3D human pose estimation from monocular images, with the help of large-scale in-door 3D datasets and sophisticated network architec…
Unsupervised Cross-spectral Stereo Matching by Learning to Synthesize
Mingyang Liang, Xiaoyang Guo, Hongsheng Li +2
Unsupervised cross-spectral stereo matching aims at recovering disparity given cross-spectral image pairs without any supervision in the form of ground truth disparity or depth. Th…
Unsupervised Bi-directional Flow-based Video Generation from one Snapshot
Lu Sheng, Junting Pan, Jiaming Guo +3
Imagining multiple consecutive frames given one single snapshot is challenging, since it is difficult to simultaneously predict diverse motions from a single image and faithfully g…
DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Images
Yuying Ge, Ruimao Zhang, Lingyun Wu +3
Understanding fashion images has been advanced by benchmarks with rich annotations such as DeepFashion, whose labels include clothing categories, landmarks, and consumer-commercial…