activity
20162025
most citedLingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling

184 citations · 557 across the 54 of their papers we have counts for

collaborators
Showing 2022Show all

8 papers · 1 filter

cs.CL2022

E2E Segmentation in a Two-Pass Cascaded Encoder ASR Model

W. Ronny Huang, Shuo-Yiin Chang, Tara N. Sainath +7

We explore unifying a neural segmenter with two-pass cascaded encoder ASR into a single model. A key challenge is allowing the segmenter (which runs in real-time, synchronously wit…

cs.CL2022★ 1 cited

JOIST: A Joint Speech and Text Streaming Model For ASR

Tara N. Sainath, Rohit Prabhavalkar, Ankur Bapna +6

We present JOIST, an algorithm to train a streaming, cascaded, encoder end-to-end (E2E) model with both speech-text paired inputs, and text-only unpaired inputs. Unlike previous wo…

cs.CL2022

Modular Hybrid Autoregressive Transducer

Zhong Meng, Tongzhou Chen, Rohit Prabhavalkar +10

Text-only adaptation of a transducer model remains challenging for end-to-end speech recognition since the transducer has no clearly separated acoustic model (AM), language model (…

cs.CL2022

Improving Deliberation by Text-Only and Semi-Supervised Training

Ke Hu, Tara N. Sainath, Yanzhang He +4

Text-only and semi-supervised training based on audio-only data has gained popularity recently due to the wide availability of unlabeled text and speech data. In this work, we prop…

cs.SD2022

E2E Segmenter: Joint Segmenting and Decoding for Long-Form ASR

W. Ronny Huang, Shuo-yiin Chang, David Rybach +5

Improving the performance of end-to-end ASR models on long utterances ranging from minutes to hours in length is an ongoing challenge in speech recognition. A common solution is to…

cs.CL2022

Improving Rare Word Recognition with LM-aware MWER Training

Weiran Wang, Tongzhou Chen, Tara N. Sainath +10

Language models (LMs) significantly improve the recognition accuracy of end-to-end (E2E) models on words rarely seen during training, when used in either the shallow fusion or the…

eess.AS2022

A Unified Cascaded Encoder ASR Model for Dynamic Model Sizes

Shaojin Ding, Weiran Wang, Ding Zhao +11

In this paper, we propose a dynamic cascaded encoder Automatic Speech Recognition (ASR) model, which unifies models for different deployment scenarios. Moreover, the model can sign…

cs.CL2022

Neural-FST Class Language Model for End-to-End Speech Recognition

Antoine Bruguier, Duc Le, Rohit Prabhavalkar +7

We propose Neural-FST Class Language Model (NFCLM) for end-to-end speech recognition, a novel method that combines neural network language models (NNLMs) and finite state transduce…