6 papers · 1 filter
Image Captioning through Image Transformer
Sen He, Wentong Liao, Hamed R. Tavakoli +3
Automatic captioning of images is a task that combines the challenges of image analysis and text generation. One important aspect in captioning is the notion of attention: How to d…
Understanding and Visualizing Deep Visual Saliency Models
Sen He, Hamed R. Tavakoli, Ali Borji +2
Recently, data-driven deep saliency models have achieved high performance and have outperformed classical saliency models, as demonstrated by results on datasets such as the MIT300…
Human Attention in Image Captioning: Dataset and Analysis
Sen He, Hamed R. Tavakoli, Ali Borji +1
In this work, we present a novel dataset consisting of eye movements and verbal descriptions recorded synchronously over images. Using this data, we study the differences in human…
What Catches the Eye? Visualizing and Understanding Deep Saliency Models
Sen He, Ali Borji, Yang Mi +1
Deep convolutional neural networks have demonstrated high performances for fixation prediction in recent years. How they achieve this, however, is less explored and they remain to…
Aggregated Sparse Attention for Steering Angle Prediction
Sen He, Dmitry Kangin, Yang Mi +1
In this paper, we apply the attention mechanism to autonomous driving for steering angle prediction. We propose the first model, applying the recently introduced sparse attention m…
Salient Region Segmentation
Sen He, Nicolas Pugeault
Saliency prediction is a well studied problem in computer vision. Early saliency models were based on low-level hand-crafted feature derived from insights gained in neuroscience an…