CRAM: Clued Recurrent Attention Model
arXiv:1804.10844
Abstract
To overcome the poor scalability of convolutional neural network, recurrent attention model(RAM) selectively choose what and where to look on the image. By directing recurrent attention model how to look the image, RAM can be even more successful in that the given clue narrow down the scope of the possible focus zone. In this perspective, this work proposes clued recurrent attention model (CRAM) which add clue or constraint on the RAM better problem solving. CRAM follows encoder-decoder framework, encoder utilizes recurrent attention model with spatial transformer network and decoder which varies depending on the task. To ensure the performance, CRAM tackles two computer vision task. One is the image classification task, with clue given as the binary image saliency which indicates the approximate location of object. The other is the inpainting task, with clue given as binary mask which indicates the occluded part. In both tasks, CRAM shows better performance than existing methods showing the successful extension of RAM.
References in corpus (7)
- Adam: A Method for Stochastic Optimization
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
- DRAW: A Recurrent Neural Network For Image Generation
- Multiple Object Recognition with Visual Attention
- Learning Deconvolution Network for Semantic Segmentation
- Recurrent Attentional Networks for Saliency Detection