Action Recognition using Visual Attention

Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov

We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units…