406 citations · 3.1k across the 87 of their papers we have counts for
7 papers · 1 filter
Unsupervised Vision-and-Language Pre-training Without Parallel Images and Captions
Liunian Harold Li, Haoxuan You, Zhecan Wang +3
Pre-trained contextual vision-and-language (V&L) models have achieved impressive performance on various benchmarks. However, existing models require a large amount of parallel imag…
Analogical Reasoning for Visually Grounded Language Acquisition
Bo Wu, Haoyu Qin, Alireza Zareian +2
Children acquire language subconsciously by observing the surrounding world and listening to descriptions. They can discover the meaning of words even without explicit language kno…
COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation
Qingyun Wang, Manling Li, Xuan Wang +24
To combat COVID-19, both clinicians and scientists need to digest vast amounts of relevant biomedical knowledge in scientific literature to understand the disease mechanism and rel…
Training with Streaming Annotation
Tongtao Zhang, Heng Ji, Shih-Fu Chang +1
In this paper, we address a practical scenario where training data is released in a sequence of small-scale batches and annotation in earlier phases has lower quality than the late…
Learning to Learn Words from Visual Scenes
Dídac Surís, Dave Epstein, Heng Ji +2
Language acquisition is the process of learning words from the surrounding scene. We introduce a meta-learning framework that learns how to learn word representations from unconstr…
Entity-aware Image Caption Generation
Di Lu, Spencer Whitehead, Lifu Huang +2
Current image captioning approaches generate descriptions which lack specific information, such as named entities that are involved in the images. In this paper we propose a new ta…
Multilingual Visual Sentiment Concept Matching
Nikolaos Pappas, Miriam Redi, Mercan Topkara +4
The impact of culture in visual emotion perception has recently captured the attention of multimedia research. In this study, we pro- vide powerful computational linguistics tools…