187 citations · 223 across the 7 of their papers we have counts for
13 papers
On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization
Shruti Palaskar, Akshita Bhagia, Yonatan Bisk +3
Combining the visual modality with pretrained language models has been surprisingly effective for simple descriptive tasks such as image captioning. More general text generation ho…
Speech Summarization using Restricted Self-Attention
Roshan Sharma, Shruti Palaskar, Alan W Black +1
Speech summarization is typically performed by using a cascade of speech recognition and text summarization models. End-to-end modeling of speech summarization models is challengin…
How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language
Amanda Duarte, Shruti Palaskar, Lucas Ventura +5
One of the factors that have hindered progress in the areas of sign language recognition, translation, and production is the absence of large annotated datasets. Towards this end,…
ASR Error Correction and Domain Adaptation Using Machine Translation
Anirudh Mani, Shruti Palaskar, Nimshi Venkat Meripo +2
Off-the-shelf pre-trained Automatic Speech Recognition (ASR) systems are an increasingly viable service for companies of any size building speech-based products. While these ASR sy…
Multimodal Abstractive Summarization for How2 Videos
Shruti Palaskar, Jindrich Libovický, Spandana Gella +1
In this paper, we study abstractive summarization for open-domain videos. Unlike the traditional text news summarization, the goal is less to "compress" text information but rather…
Learned In Speech Recognition: Contextual Acoustic Word Embeddings
Shruti Palaskar, Vikas Raunak, Florian Metze
End-to-end acoustic-to-word speech recognition models have recently gained popularity because they are easy to train, scale well to large amounts of training data, and do not requi…