167 citations · 546 across the 27 of their papers we have counts for
5 papers · 1 filter
Diverse and Accurate Image Description Using a Variational Auto-Encoder with an Additive Gaussian Encoding Space
Liwei Wang, Alexander G. Schwing, Svetlana Lazebnik
This paper explores image caption generation using conditional variational auto-encoders (CVAEs). Standard CVAEs with a fixed Gaussian prior yield descriptions with too little vari…
Conditional Image-Text Embedding Networks
Bryan A. Plummer, Paige Kordas, M. Hadi Kiapour +3
This paper presents an approach for grounding phrases in images which jointly learns multiple text-conditioned embeddings in a single end-to-end model. In order to differentiate te…
PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning
Arun Mallya, Svetlana Lazebnik
This paper presents a method for adding multiple tasks to a single deep neural network while avoiding catastrophic forgetting. Inspired by network pruning techniques, we exploit re…
Learning Two-Branch Neural Networks for Image-Text Matching Tasks
Liwei Wang, Yin Li, Jing Huang +1
Image-language matching tasks have recently attracted a lot of attention in the computer vision field. These tasks include image-sentence matching, i.e., given an image query, retr…
Recurrent Models for Situation Recognition
Arun Mallya, Svetlana Lazebnik
This work proposes Recurrent Neural Network (RNN) models to predict structured 'image situations' -- actions and noun entities fulfilling semantic roles related to the action. In c…