activity
20172023
most citedLingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling

184 citations · 252 across the 19 of their papers we have counts for

collaborators

20 papers

eess.AS2023★ 1 cited

Massive End-to-end Models for Short Search Queries

Weiran Wang, Rohit Prabhavalkar, Dongseong Hwang +11

In this work, we investigate two popular end-to-end automatic speech recognition (ASR) models, namely Connectionist Temporal Classification (CTC) and RNN-Transducer (RNN-T), for of…

cs.SD2022★ 9 cited

Unified End-to-End Speech Recognition and Endpointing for Fast and Efficient Speech Systems

Shaan Bijwadia, Shuo-yiin Chang, Bo Li +3

Automatic speech recognition (ASR) systems typically rely on an external endpointer (EP) model to identify speech boundaries. In this work, we propose a method to jointly train the…

cs.CL2022

Improving Rare Word Recognition with LM-aware MWER Training

Weiran Wang, Tongzhou Chen, Tara N. Sainath +10

Language models (LMs) significantly improve the recognition accuracy of end-to-end (E2E) models on words rarely seen during training, when used in either the shallow fusion or the…

eess.AS2022★ 1 cited

Personal VAD 2.0: Optimizing Personal Voice Activity Detection for On-Device Speech Recognition

Shaojin Ding, Rajeev Rikhye, Qiao Liang +5

Personalization of on-device speech recognition (ASR) has seen explosive growth in recent years, largely due to the increasing popularity of personal assistant features on mobile d…

eess.AS2022

4-bit Conformer with Native Quantization Aware Training for Speech Recognition

Shaojin Ding, Phoenix Meadowlark, Yanzhang He +3

Reducing the latency and model size has always been a significant research problem for live Automatic Speech Recognition (ASR) application scenarios. Along this direction, model qu…

eess.AS2022

Closing the Gap between Single-User and Multi-User VoiceFilter-Lite

Rajeev Rikhye, Quan Wang, Qiao Liang +2

VoiceFilter-Lite is a speaker-conditioned voice separation model that plays a crucial role in improving speech recognition and speaker verification by suppressing overlapping speec…

eess.AS2021★ 2 cited

Learning Word-Level Confidence For Subword End-to-End ASR

David Qiu, Qiujia Li, Yanzhang He +9

We study the problem of word-level confidence estimation in subword-based end-to-end (E2E) models for automatic speech recognition (ASR). Although prior works have proposed trainin…

cs.CL2020

Less Is More: Improved RNN-T Decoding Using Limited Label Context and Path Merging

Rohit Prabhavalkar, Yanzhang He, David Rybach +4

End-to-end models that condition the output label sequence on all previously predicted labels have emerged as popular alternatives to conventional systems for automatic speech reco…

eess.AS2020★ 2 cited

A Better and Faster End-to-End Model for Streaming ASR

Bo Li, Anmol Gulati, Jiahui Yu +12

End-to-end (E2E) models have shown to outperform state-of-the-art conventional models for streaming speech recognition [1] across many dimensions, including quality (as measured by…

eess.AS2020★ 3 cited

Confidence Estimation for Attention-based Sequence-to-sequence Models for Speech Recognition

Qiujia Li, David Qiu, Yu Zhang +5

For various speech-related tasks, confidence scores from a speech recogniser are a useful measure to assess the quality of transcriptions. In traditional hidden Markov model-based…

eess.AS2020★ 6 cited

FastEmit: Low-latency Streaming ASR with Sequence-level Emission Regularization

Jiahui Yu, Chung-Cheng Chiu, Bo Li +8

Streaming automatic speech recognition (ASR) aims to emit each hypothesized word as quickly and accurately as possible. However, emitting fast without degrading quality, as measure…

eess.AS2020★ 10 cited

VoiceFilter-Lite: Streaming Targeted Voice Separation for On-Device Speech Recognition

Quan Wang, Ignacio Lopez Moreno, Mert Saglam +8

We introduce VoiceFilter-Lite, a single-channel source separation model that runs on the device to preserve only the speech signals from a target user, as part of a streaming speec…

eess.AS2020★ 1 cited

Parallel Rescoring with Transformer for Streaming On-Device Speech Recognition

Wei Li, James Qin, Chung-Cheng Chiu +2

Recent advances of end-to-end models have outperformed conventional models through employing a two-pass model. The two-pass model provides better speed-quality trade-offs for on-de…

cs.CL2020

Analyzing the Quality and Stability of a Streaming End-to-End On-Device Speech Recognizer

Yuan Shangguan, Kate Knister, Yanzhang He +2

The demand for fast and accurate incremental speech recognition increases as the applications of automatic speech recognition (ASR) proliferate. Incremental speech recognizers outp…

eess.AS2020★ 3 cited

Towards Fast and Accurate Streaming End-to-End ASR

Bo Li, Shuo-yiin Chang, Tara N. Sainath +4

End-to-end (E2E) models fold the acoustic, pronunciation and language models of a conventional speech recognition model into one neural network with a much smaller number of parame…

cs.CL2020★ 3 cited

A Streaming On-Device End-to-End Model Surpassing Server-Side Conventional Model Quality and Latency

Tara N. Sainath, Yanzhang He, Bo Li +26

Thus far, end-to-end (E2E) models have not been shown to outperform state-of-the-art conventional models with respect to both quality, i.e., word error rate (WER), and latency, i.e…

cs.CL2019

Two-Pass End-to-End Speech Recognition

Tara N. Sainath, Ruoming Pang, David Rybach +9

The requirements for many applications of state-of-the-art speech recognition systems include not only low word error rate (WER) but also low latency. Specifically, for many use-ca…

cs.LG2019★ 184 cited

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling

Jonathan Shen, Patrick Nguyen, Yonghui Wu +88

Lingvo is a Tensorflow framework offering a complete solution for collaborative deep learning research, with a particular focus towards sequence-to-sequence models. Lingvo models a…

cs.CL2018★ 23 cited

Streaming End-to-end Speech Recognition For Mobile Devices

Yanzhang He, Tara N. Sainath, Rohit Prabhavalkar +17

End-to-end (E2E) models, which directly predict output character sequences given input speech, are good candidates for on-device speech recognition. E2E models, however, present nu…

cs.CL2017★ 4 cited

Streaming Small-Footprint Keyword Spotting using Sequence-to-Sequence Models

Yanzhang He, Rohit Prabhavalkar, Kanishka Rao +3

We develop streaming keyword spotting systems using a recurrent neural network transducer (RNN-T) model: an all-neural, end-to-end trained, sequence-to-sequence model which jointly…