activity
20152022
most citedHow2: A Large-scale Dataset for Multimodal Language Understanding

187 citations · 698 across the 55 of their papers we have counts for

collaborators
Showing 2022 · cs.CLShow all

5 papers · 2 filters

cs.CL2022

Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models

Siddhant Arora, Siddharth Dalmia, Brian Yan +3

End-to-end spoken language understanding (SLU) systems are gaining popularity over cascaded approaches due to their simplicity and ability to avoid error propagation. However, thes…

cs.CL2022★ 1 cited

CTC Alignments Improve Autoregressive Translation

Brian Yan, Siddharth Dalmia, Yosuke Higuchi +4

Connectionist Temporal Classification (CTC) is a widely used approach for automatic speech recognition (ASR) that performs conditionally independent monotonic alignment. However fo…

cs.CL2022

ASR2K: Speech Recognition for Around 2000 Languages without Audio

Xinjian Li, Florian Metze, David R Mortensen +2

Most recent speech recognition models rely on large supervised datasets, which are unavailable for many low-resource languages. In this work, we present a speech recognition pipeli…

cs.CL2022

LegoNN: Building Modular Encoder-Decoder Models

Siddharth Dalmia, Dmytro Okhonko, Mike Lewis +5

State-of-the-art encoder-decoder models (e.g. for machine translation (MT) or automatic speech recognition (ASR)) are constructed and trained end-to-end as an atomic unit. No compo…

cs.CL2022

On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization

Shruti Palaskar, Akshita Bhagia, Yonatan Bisk +3

Combining the visual modality with pretrained language models has been surprisingly effective for simple descriptive tasks such as image captioning. More general text generation ho…