10 citations · 12 across the 6 of their papers we have counts for
4 papers · 1 filter
RubiCap: Rubric-Guided Reinforcement Learning for Dense Image Captioning
Tzu-Heng Huang, Sirajul Salekin, Javier Movellan +2
Dense image captioning is critical for vision-language pretraining and for text-to-image generation, but scaling expert-quality annotations is prohibitively expensive. While synthe…
Probabilistic Attention for Interactive Segmentation
Prasad Gabbur, Manjot Bilkhu, Javier Movellan
We provide a probabilistic interpretation of attention and show that the standard dot-product attention in transformers is a special case of Maximum A Posteriori (MAP) inference. T…
Attention is all you need for Videos: Self-attention based Video Summarization using Universal Transformers
Manjot Bilkhu, Siyang Wang, Tushar Dobhal
Video Captioning and Summarization have become very popular in the recent years due to advancements in Sequence Modelling, with the resurgence of Long-Short Term Memory networks (L…
Human Activity Recognition for Edge Devices
Manjot Bilkhu, Hammababdullah Ayyubi
Video activity Recognition has recently gained a lot of momentum with the release of massive Kinetics (400 and 600) data. Architectures such as I3D and C3D networks have shown stat…