67 citations · 192 across the 21 of their papers we have counts for
21 papers
Collaborative Intelligence Orchestration: Inconsistency-Based Fusion of Semi-Supervised Learning and Active Learning
Jiannan Guo, Yangyang Kang, Yu Duan +6
While annotating decent amounts of data to satisfy sophisticated learning models can be cost-prohibitive for many real-world applications. Active learning (AL) and semi-supervised…
RoSA: A Robust Self-Aligned Framework for Node-Node Graph Contrastive Learning
Yun Zhu, Jianhao Guo, Fei Wu +1
Graph contrastive learning has gained significant progress recently. However, existing works have rarely explored non-aligned node-node contrasting. In this paper, we propose a nov…
Relational Graph Learning for Grounded Video Description Generation
Wenqiao Zhang, Xin Eric Wang, Siliang Tang +5
Grounded video description (GVD) encourages captioning models to attend to appropriate video regions (e.g., objects) dynamically and generate a description. Such a setting can help…
Run Away From your Teacher: Understanding BYOL by a Novel Self-Supervised Approach
Haizhou Shi, Dongliang Luo, Siliang Tang +2
Recently, a newly proposed self-supervised framework Bootstrap Your Own Latent (BYOL) seriously challenges the necessity of negative samples in contrastive learning frameworks. BYO…
MGD-GAN: Text-to-Pedestrian generation through Multi-Grained Discrimination
Shengyu Zhang, Donghui Wang, Zhou Zhao +3
In this paper, we investigate the problem of text-to-pedestrian synthesis, which has many potential applications in art, design, and video surveillance. Existing methods for text-t…
Two Step Joint Model for Drug Drug Interaction Extraction
Siliang Tang, Qi Zhang, Tianpeng Zheng +7
When patients need to take medicine, particularly taking more than one kind of drug simultaneously, they should be alarmed that there possibly exists drug-drug interaction. Interac…
Topic Adaptation and Prototype Encoding for Few-Shot Visual Storytelling
Jiacheng Li, Siliang Tang, Juncheng Li +4
Visual Storytelling~(VIST) is a task to tell a narrative story about a certain topic according to the given photo stream. The existing studies focus on designing complex models, wh…
Deep Sequential Feature Learning in Clinical Image Classification of Infectious Keratitis
Yesheng Xu, Ming Kong, Wenjia Xie +7
Infectious keratitis is the most common entities of corneal diseases, in which pathogen grows in the cornea leading to inflammation and destruction of the corneal tissues. Infectio…
NTIRE 2020 Challenge on Real Image Denoising: Dataset, Methods and Results
Abdelrahman Abdelhamed, Mahmoud Afifi, Radu Timofte +87
This paper reviews the NTIRE 2020 challenge on real image denoising with focus on the newly introduced dataset, the proposed methods and their results. The challenge is a new versi…
Quda: Natural Language Queries for Visual Data Analytics
Siwei Fu, Kai Xiong, Xiaodong Ge +3
The identification of analytic tasks from free text is critical for visualization-oriented natural language interfaces (V-NLIs) to suggest effective visualizations. However, it is…
Generating Natural Language Adversarial Examples on a Large Scale with Generative Models
Yankun Ren, Jianbin Lin, Siliang Tang +4
Today text classification models have been widely used. However, these classifiers are found to be easily fooled by adversarial examples. Fortunately, standard attacking methods ge…
Grounded and Controllable Image Completion by Incorporating Lexical Semantics
Shengyu Zhang, Tan Jiang, Qinghao Huang +7
In this paper, we present an approach, namely Lexical Semantic Image Completion (LSIC), that may have potential applications in art, design, and heritage conservation, among severa…
Deep Neural Network for Fast and Accurate Single Image Super-Resolution via Channel-Attention-based Fusion of Orientation-aware Features
Du Chen, Zewei He, Yanpeng Cao +5
Recently, Convolutional Neural Networks (CNNs) have been successfully adopted to solve the ill-posed single image super-resolution (SISR) problem. A commonly used strategy to boost…
Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigation
Juncheng Li, Xin Wang, Siliang Tang +4
Visual navigation is a task of training an embodied agent by intelligently navigating to a target object (e.g., television) using only visual observations. A key challenge for curr…
Learning Dynamic Context Augmentation for Global Entity Linking
Xiyuan Yang, Xiaotao Gu, Sheng Lin +6
Despite of the recent success of collective entity linking (EL) methods, these "global" inference methods may yield sub-optimal results when the "all-mention coherence" assumption…
Walking with MIND: Mental Imagery eNhanceD Embodied QA
Juncheng Li, Siliang Tang, Fei Wu +1
The EmbodiedQA is a task of training an embodied agent by intelligently navigating in a simulated environment and gathering visual information to answer questions. Existing approac…
Informative Visual Storytelling with Cross-modal Rules
Jiacheng Li, Haizhou Shi, Siliang Tang +2
Existing methods in the Visual Storytelling field often suffer from the problem of generating general descriptions, while the image contains a lot of meaningful contents remaining…
KCAT: A Knowledge-Constraint Typing Annotation Tool
Sheng Lin, Luye Zheng, Bo Chen +6
Fine-grained Entity Typing is a tough task which suffers from noise samples extracted from distant supervision. Thousands of manually annotated samples can achieve greater performa…
Posterior-regularized REINFORCE for Instance Selection in Distant Supervision
Qi Zhang, Siliang Tang, Xiang Ren +3
This paper provides a new way to improve the efficiency of the REINFORCE training process. We apply it to the task of instance selection in distant supervision. Modeling the instan…
Improving Distantly-supervised Entity Typing with Compact Latent Space Clustering
Bo Chen, Xiaotao Gu, Yufeng Hu +4
Recently, distant supervision has gained great success on Fine-grained Entity Typing (FET). Despite its efficiency in reducing manual labeling efforts, it also brings the challenge…
Cross-relation Cross-bag Attention for Distantly-supervised Relation Extraction
Yujin Yuan, Liyuan Liu, Siliang Tang +5
Distant supervision leverages knowledge bases to automatically label instances, thus allowing us to train relation extractor without human annotations. However, the generated train…