Survey of Recent Advances in Visual Question Answering
arXiv:1709.08203
Abstract
Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how to perform reasoning over this multi-modal representation so it can answer the questions correctly. This paper presents a survey of different approaches proposed to solve the problem of Visual Question Answering. We also describe the current state of the art model in later part of paper. In particular, the paper describes the approaches taken by various algorithms to extract image features, text features and the way these are employed to predict answers. We also briefly discuss the experiments performed to evaluate the VQA models and report their performances on diverse datasets including newly released VQA2.0[8].
arXiv comment7 pages, 2 tables
References in corpus (6)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Microsoft COCO Captions: Data Collection and Evaluation Server
- VQA: Visual Question Answering
- Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
- Show, Ask, Attend, and Answer: A Strong Baseline For Visual Question Answering
- Dual Attention Networks for Multimodal Reasoning and Matching
Cited by in corpus (4)
- Understand, Compose and Respond - Answering Visual Questions by a Composition of Abstract Procedures
- Applying recent advances in Visual Question Answering to Record Linkage
- Non-monotonic Logical Reasoning Guiding Deep Learning for Explainable Visual Question Answering
- Adversarial Multimodal Network for Movie Question Answering